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(57) An MPEG1 real time encoder board (213) gen- 
erates index data as an evaluation value representing 
the complexity of a picture. A scene change parameter 
representing the degree of a scene change occurring in 
the picture is then calculated from the index data. The 
scene change parameter is associated with a scene 
change pointer, that is, position information on a loca- 
tion of the picture in which a scene change occurs to a 
degree indicated by the scene change parameter. The 



scene change parameter and the scene change pointer 
are recorded as an index in an index file. On the other 
hand, an MPEG system stream output by the MPEG1 
real time encoder board (213) is stored in an MPEG file 
separated from the index file. 

With the funtions described above, a desired scene can 
be searched for with ease. 
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Description 

BACKGROUND OF THE INVENTION In general, the present invention relates to a 

picture processing apparatus, a picture processing method and a recording medium. In particular, the present 
invention relates to a picture processing apparatus, a picture processing method and a recording medium being capa- 
ble of carrying out search of a desired scene with ease. 

With the increasing speed and the increasing number of functions of the CPU (Central Processing Unit) as well as 
the increasing storage capacity of the memory, the hard disc and other recording and storage media along with the 
decreasing price of hardware including the CPU and the recording and the storage media seen in recent years, a high 
performance computer can be implemented at a price that the personal user can afford. 

With the popularization of a high performance connputer at such a price, there is a rising user demand for computer 
functions of can-ying out various kinds of processing such as recording, reproduction and editing of a processing object 
with a large amount of data such as a picture which were impossible so far but can now be implemented through simple 
user operations. 

SUMMARY OF THE INVENTION 

It is thus an object of the present invention addressing the problem described above to allow various kinds of 
processing demanded by the user to be carried out through simple operations. 

A picture processing apparatus for processing a picture according to claim 1 is characterized in that said apparatus 
comprises: 

a computing means for computing a scene change parameter representing a degree of a scene change in said pic- 
ture; and 

a recording means for recording said scene change parameter and position information on a position of said picture 
with a degree of a scene change thereof represented by said scene change parameter by associating said scene 
change parameter with said position information. 

A picture processing method for processing a picture according to daim 9 is characterized in that said method com- 
prises the steps of: 

computing a scene change parameter representing a degree of a scene change in said picture; and 
recording said scene change parameter and position information on a position of said picture with a degree of a 
scene change thereof represented by said scene change parameter by associating said scene change parameter 
with said position information. 

A recording medium for storing a program to let a corrputer process a picture according to daim 10 is characterized 
in that said program prescribes a picture processing method conrprising the steps of: 

computing a scene change parameter representing a degree of a scene change in said picture; and 
recording said scene change parameter arxl position information on a position of said picture with a degree of a 
scene change thereof represented by said scene change parameter by associating said scene change parameter 
with said position information. 

A recording medium according to claim 1 1 is characterized in that said medium is used for storing data obtained as 
a result of processing a picture in addition to a scene change parameter and position information on a position of said 
picture with a degree of a scene change tiiereof represented by said scene change parameter by associating said 
scene change parameter with said position information. 

In a picture processing apparatus for processing a picture according to claim 1 , 

a computing means computes a scene change parameter representing a degree of a scene change in said picture; 
and 

a recording means records said scene change parameter and position information on a position of said picture witii 
a degree of a scene change thereof represented by said scene change parameter by associating said scene 
change parameter with said position information. 

A picture processing method for processing a picture according to claim 9 comprises the steps of: 
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computing a scene change parameter representing a degree of a scene change in said picture; and 
recording said scene change parameter and position information on a position of said picture with a degree of a 
scene change thereof represented by said scene change parameter by associating said scene change parameter 
with said position information. 

5 

A recording medium according to claim 10 is used for storing a program to let a computer process a picture wherein 
said program prescribes a picture processing method comprising the steps of: 

computing a scene change parameter representing a degree of a scene change In said picture; and 
10 recording said scene change parameter and position information on a position of said picture with a degree of a 
scene change thereof represented by said scene change parameter by associating said scene change parameter 
with said position information. 

A recording medium according to daim 1 1 is used for storing data obtained as a result of processing a picture in 
75 addition to a scene change parameter and position information on a position of said picture with a degree of a scene 
change thereof represented by said scene change parameter by associating said scene change parameter with said 
position information. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 

Prefen'ed embodiments of the present invention will be described by refenring to the following diagrams wherein: 

Fig. 1 is a diagram showing a perspective view of a typical configuration of an embodiment innplementing a per- 
sonal computer to which the present invention is applied; 
25 Fig. 2 is a diagram showing a perspective view of a typical configuration of an embodiment innplementing a per- 
sonal conrputer to which the present invention is applied; 

Fig. 3 is a diagram showing a front view of a main unit 31 of the personal computers shown in Rgs. 1 and 2; 
Fig. 4 is a diagram showing a rear view of the main unit 31 shown in Fig. 3; 

Fig. 5 is a diagram showing a typical electrical configuration of the personal computer shown in Figs. 1 and 2; 
30 Fig. 6 is a diagram showing a typical configuration of an MPEG1 real time encoder board 213 employed in the per- 
sonal computer shown in Fig. 5; 

Fig. 7 is a diagram showing a slip recorder main window 301 ; 
Fig. 8 is a diagram showing a tape setting dialog box 321 ; 
Fig. 9A and 9B are diagrams used for explaining normal and endless tapes; 
35 Fig. 1 0 is a table showing specifications for a variety of video recording modes; 

Fig. 1 1 shows a flowchart representing a recording process wherein a normal tape has been set as a tape used in 
the recording process; 

Fig. 12 shows a flowchart representing a recording process wherein an endless tape has been set as a tape used 
in the recording process; 

40 Fig. 13 shows a flowchart representing an index recording process to record index data in an index file; 
Fig. 14 Is a diagram showing a typical format of index data; 
Fig. 1 5 Is a diagram showing a playback window 341 ; 

Fig. 16 Is a diagram used for explaining a lapsing period of time, a remaining period of time and a recording point 
of time; 

45 Fig. 1 7 shows a ffowchart representing a slip playback process; 

Fig. 1 8 is a block diagram used for explaining processing carried out by execution of a slip recorder application pro- 
gram; 

Fig. 19 is a diagram showing variations of a scene change parameter with the lapse of time; 
Fig. 20 shows a flowchart representing processing carried out by a controller 133; 
50 Fig. 21 Is a diagram showing a clip editor main window 361 ; 

Fig. 22 is a diagram showing an index display level setting dialog box 381 ; and 

Fig. 23 shows a flowchart representing an Index screen displaying process for displaying index screens on a source 
window 362, Fig. 24 is a diagram showing a clip viewer main window 401 . 

55 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention will become more apparent from a careful study of the following detailed description of some 
prefen'ed embodiments with reference to the accompanying diagrams. Before starting the description. In order to clarify 
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the relation between a variety of means cited in claims of the patent specification and the embodiments, characteristics 
of the present invention are explained by appending an embodiment to each means corresponding to the embodiment 
as a phrase expressed in a form 'implemented typically by an embodiment' enclosed in parentheses as follows. 
A picture processing apparatus for processing a picture according to claim 1 is characterized by comprising: 

a computing means (implemented typically by an embodiment such as a processing step S34 of a program shown 
in Fig. 13) for computing a scene change parameter representing a degree of a scene change in said picture; and 
a recording means (implemented typically by an embodiment such as a processing step S36 of the program shown 
in Fig. 13) for recording said scene change parameter and position information on a position of said picture with a 
degree of a scene change thereof represented by said scene change parameter by associating said scene change 
parameter with said position information. 

According to claim 2. a picture processing apparatus claimed as claim 1 is further characterized by also having: 

a threshold value setting means (implemented typically by an embodiment such as an index display level setting 
dialog box 381 shown in Fig. 22) for setting a threshold value of said scene change parameter; and 
a display means (implemented typically by an embodiment such as a source window 362 shown in Fig. 21) for dis- 
playing a screen of said picture at a position indicated by said position information associated with said scene 
change parameter representing a degree off a scene change equal to or higher than said threshold value set by 
using said threshold value setting means. 

According to claim 3, a picture processing apparatus claimed as claim 1 is further characterized by also having: 

a scene change parameter count setting means (implemented typically by an embodiment such as the index dis- 
play level setting dialog box 381 shown in Fig. 22) for setting a scene change parameter count; and 
a display means for displaying screens (implemented typically by an embodiment such as the source window 362 
shown in Fig. 21) of said pictures at positions indicated by pieces off said position infbrn^tion associated with said 
scene change parameters representing highest degrees of scene changes wherein the number of screens to be 
displayed does not exceed said scene change parameter count set by using said scene change parameter count 
setting means. 

According to claim 4. a picture processing apparatus claimed as claim 1 is further characterized by also having: 

a range setting means (inr»plemented typically by an embodiment such as the index display level setting dialog box 
381 shown in Fig. 22) for setting a range to be searched for a scene change parameter representing a highest 
degree of a scene change among scene changes in said range; and 

a display means (implemented typically by an embodiment such as the source window 362 shown in Fig. 21) for 
searching each range set by said range setting means for a specific scene change parameter representing a high- 
est degree of a scene change among scene changes in said range and displaying a screen of said picture at a posi- 
tion indicated by said position information associated with said specific scene change parameter. 

According to claim 5, a picture processing apparatus claimed as claim 1 is further characterized by also having: 

a detection means (implemented typically by an embodiment such as a processing step S35 of the program shown 
in Fig. 1 3) for detecting a scene change parameter representing a degree off a scene change equal to or higher than 
a predetermined level ; and 

a display means (implemented typically by an embodiment such as a scene change indicator 303 shown in Fig. 7) 
for displaying detection of a scene change parameter representing a degree of a scene change equal to or higher 
than said predetermined level. 

According to claim 1, a picture processing apparatus claimed as claim 6 is further characterized by also having an 
encoding means (implemented typically by an embodiment such as an MPEQ1 real time encoder board 213 shown in 
Fig. 5) for encoding said picture to be recorded by said recording means. 

It should be noted that, of course, the embodiments appended to the means associated with the embodiments are 
not intended to be construed in a limiting sense. That is to say, implementation of a means is not limited to the embod- 
iment appended to the means. 

Figs. 1 and 2 are diagrams each showing a typical configuration of an embodiment implementing a personal com- 
puter to which the present invention is applied. 
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As shown in the figures, the personal computer comprises a main unit 31, a keyfc}oard 21 as well as a mouse 22 
operated by the user for entering a command to the nrrain unit 31 and a display apparatus 51 for displaying a picture. 

The main unit 31 is of the so-called mini tower type with a typical width of 225 mm. a typical height of 367.9 mm 
and a typical depth of 451.5 mm. A right front corner surface 32 is provided between a front surface and a right side 
5 surface, diagonally crossing the corner between the front surface and the right side surface. By the same token, a left 
front corner surface 33 Is provided between the front surface and a left side surface, diagonally crossing the corner 
between the front surface and the left side surface. At the upper portion of the right front corner surface 32, a power 
supply button 34 is provided. The power supply button 34 is operated to turn on and off the power supply of the main 
unit 31. 

10 A dent 35 is provided on the top surface of the main unit 31 at a position which will coincide with the feel of a periph- 
eral unit connected to the main unit 31 to be mounted thereon. When the peripheral unit is mounted on the main unit 
31 , the feet of the peripheral unit are placed in the dent 35 so that the feet of peripheral unit are engaged with the dent 
31 of the main unit in a stable sfate. 

The front surface of the main unit 31 comprises a lower panel 36 and an upper panel 37. The tower panel 36 is nor- 

15 mally pushed in the outward direction to protrude outward by a force of a spring not shown in the figure. The user can 
press the lower panel 36 from the outwardly protruding sfate in a direction toward the inside of the main unit 31 to a 
dented sfate. resisting the force of the spring. The upper panel 37 can be moved up and down freely along right and left 
guides 45. With the lower panel 36 in a protruding state, the motion of the upper panel 37 in the downward direction is 
blocked by the lower panel 36. 

20 When using the main unit 31 , the user presses the lower panel 36 from the outwardly protruding state in a direction 
toward the inside of the main unit 31 to a dented sfate, resisting the force of the spring. With the lower panel 36 put in 
a dented state, the restriction of the motion of the upper panel 37 In the downward direction is removed, allowing the 
upper panel 37 to be slided in the downward direction along the guides 45. As a result, an FDD (Floppy Disc Drive) 41 . 
a CD-ROM (Conrpact Disc Read-Only Memory)/CD-R (Compact Disc Recordable) drive 42 and an AV (Audio Visual) 

25 terminal unit 43 embedded in the main unit 31 are put in a state exposed to the user as shown in Rg. 2. The CD-ROM 
(Compact Disc Read-Only Memory)/CD-R (Compact Disc Recordable) drive 42 is referred to hereafter simply as a CD 
drive. 

It should be noted that the main unit 31 also has an extension unit 44 for allowing otiier predetermined apparatuses 
to be installed thereon. 

30 When the use of the personal computer is finished, the user puts a finger thereof on a dent 38 aeated on the upper 
portion of the upper panel 37 and moves the upper panel 37 in the upward direction. As the upper panel 37 moves in 
the upward direction along the guides 45, reaching a predetermined position, the lower panel 36 is restored to the out- 
wardly protruding sfate by the force of the spring. In this state, the nnotion of the upper panel 37 in the downward direc- 
tion is again blocked by the lower panel 36. 

35 As described above, the right front corner surface 32 and the left front corner surface 33 each having a taper shape 
are provided on the corners between the right side surface and the front surface and the left side surface and the front 
surface respectively In order to make the width of the main unit 31 looks narow. In addition, the upper panel 37 provided 
as part of the front surface of the main unit 31 can be slided freely and serves as a protector of devices accommodated 
in the main unit 31. When the personal computer is not used, the upper panel 37 is put in a state of concealing the 

40 accommodated devices by putting them in an unexposed sfate. As a result, a flat and simple design image can be 
implemented. 

Taking the potential application to the future AV equipment, the upper panel 37 is designed so that it can be modi- 
fied into a drawer or rofary type. 

Basically, the display apparatus 51 comprises a base 52 and a display unit 53 which is provided in such a way that 
45 it can be freely nwved in the horizontal direction (pan direction) and tiie vertical direction (tilt direction) with respect to 
the base 52. On the front portion of the base 52, a dent 54 is provided. 

As the front surface of the display unit 53, a CRT (Cathode Ray Tube) 55 is provided. The CRT 55 serves typically 
as a high precision 17-inch trinitron monitor. On the right front corner between the right side surface of the display unit 
53 and the CRT 55, a right front corner surface 56 having a taper shape is provided. On the inner side of the right front 
50 corner surface 56, a lower speaker 59 and an upper speaker 60 are provided. By the same token, on the left front corner 
between the right side surface of the display unit 53 and the CRT 55, a left front corner surface 56 having a taper shape 
is also provided and, on the inner side of the left front corner surface 57, a lower speaker 59 and an upper speaker 60 
are provided as well. With such components provided, reproduction of a high quality picture and loud high quality stereo 
sound can be realized. 

55 On the front portion of the top of the display unit 53, a microphone 24 is provided. The microphone 24 is used for 
inputting voice of the user. In conjunction with the speakers 59 and 60. the microphone 24 can be used for implement- 
ing, for example, a hands free phone. 

At the center of the top of the display unit 53. a groove 58 is provided. The groove 58 is used for accomnxxlating a 
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coKl Of the microphone 24. When a television camera of a television telephone is mounted on the display apparatus 51 , 
the cord of the television camera can also be accommodated in the groove 58. 

Fig. 3 is a diagram showing a typical detailed configuration of the front surface of the main unit 31 . 

As shown in the figure, a power supply lamp 61 is provided above the power supply button 34 described earlier. 
The power supply lamp 61 lights up to indicate that the power supply has been turned on. When the power supply is 
off, on the other hand, the power supply lamp 61 dies out. Beneath the power supply button 34, a hard disc access lamp 
63 is provided. As will be described later, the main unit 31 has an embedded hard disc 212 as shown in Fig. 5. When 
an access is being made to the hard disc 212. the hard disc access lamp 63 lights up. Typically, the hard disc access 
lamp 63 has an orange color. 

The FDD 41 is typically a driver for 3.5-inch FD with a storage capacity of 1 .44 MB (megabytes). 1 .2 MB or 720 KB 
(kilobytes). On the front surface of the FDD 41 . a floppy disc drive access lamp 64 and a floppy disc inject button 66 are 
provided. The floppy disc drive access lamp 64 lights up when an access is being made to an FD mounted on the FDD 
41 . The user presses the floppy disc inject button 66 to take out an FD from the FDD 41. 

The CD drive 42 reads out data from a CD-ROM disc not shown in the figure and reads out or writes data from or 
into a CD-R (CD-R FS) disc 21 1 showvn in Fig. 5. It shouW be noted that the CD drive 42 typically reads out data at an 
8-time speed and writes data at a double speed. 

On the front surface of the CD drive 42. an eject button 68. an eject hole 69 and an access lamp 70 are provided. 
The eject button 68 is operated to draw a tray of the CD drive 42. The eject hole 69 is operated in case the tray can not 
be drawn by pressing the eject button 68. That is to say, a stick with a sharp end is introduced into the eject hole 69 to 
draw the tray. The access lamp 70 lights up when an access is being made to a CD-ROM or the CD-R disc 21 1 mounted 
on the CD drive 42. 

The AV terminal unit 43 comprises an S video input terminal, a video input terminal for a composite signal and 2 
audio input terminals (pin jacks) for L (left) and R (right) channels. Pictures and sound recorded by a vWeo camera or 
a VTR (Video Tape Recorder) to be edited by this personal computer are entered through the terminals of the AV ter- 
minal unit 43. 

Fig. 4 is a diagram showing a typical detailed configuration of the rear surface of the main unit 31 . 

At the right upper corner of the rear surface of the main unit 31 . a power supply input terminal 71 is provided. A 
power supply cord not shown in the figure is connected to the power supply input terminal 71 to supply power to the 
main unit 31. 

At the left upper corner of the rear surface of the main unit 31 , a keyboard terminal 72 and a mouse terminal 73 are 
provided. The keyboard terminal 72 and the mouse terminal 73 are connected to the keyboard 21 and the mouse 22 
respectively Beneath the mouse terminal 73, a USB (Universal Serial Bus) terminal 74 is provkled. The USB terminal 
74 is used for connecting an apparatus conforming to USB specif ications to the main unit 31 . Below the USB terminal 
74, a printer terminal 75 and 2 serial terminals 76 are provided. The printer terminal 75 is connected to a printer or an 
image scanner. Typically, an infrared communication adapter is connected to one of the serial terminals 76. That is to 
say. in this embodiment, by connecting one of the serial terminals 76 to an infrared adapter which serves as an infrared 
communication interface, infrared communication can be implemented between the main unit 31 and another appara- 
tus. 

Beneath the printer terminal 75, a game terminal 77 is provided. The game terminal 77 is connected typically to a 
joy stick or a MIDI (Musical Instrument Digital Interface) apparatus. 

Below the serial terminal 76, a headphone terminal 78, a line input terminal 79 and a microphone terminal 80 are 
provided one beneath another in an order they are enunerated. Typically, the headphone terminal 78. the line input ter- 
minal 79 and the microphone terminal 80 are connected respectively to an external speaker, an audio apparatus and 
the microphone 24 shown in Figs. 1 and 2. 

It should be noted that, on the right skle of each of the terminals described above, pictures are shown to indicate 
what device or apparatus is to be connected to the terminal. 

Below the microphone terminal 80. a video output terminal 81 for a composite signal, an S video output terminal 
82 and a monitor terminal 83 are provided. A composite video signal and an S video signal are output from the video 
output terminal 81 for a conrposite signal and the S video output terminal 82 respectively The monitor terminal 83 is 
connected to the display apparatus 51 . 

Beneath the video output terminal 81 for a composite signal, the S video output terminal 82 and the monitor termi- 
nal 83, an AV terminal unit 84 is provided. Much like the AV terminal unit 43 on the front surface, the AV terminal unit 
84 comprises an S video input terminal, a video input terminal for a composite signal and 2 audio input terminals for the 
L and R channels. 

On the right side of the AV terminal unit 84. an antenna terminal 85 is provkied, allowing a television signal typically 
in a VHF (Very High Frequency) band and in a UHF (Ultra High Frequency) band to be received. 

On a further lower part of the rear surface of the main unit 31 , a line jack 86 and a telephone jack 87 are provided. 
The line jack 86 is connected to a telephone line and the telephone jack 87 is connected to typically a telephone set or 
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a facsimile apparatus. 

Fig. 5 is a diagram showing a typical electrical configuration of the personal computer shown in Figs. 1 and 2. 
In this embodiment, the personal computer is provided with an embedded MPEG1 (Moving Picture Experts Group) 
real time encoder board 213 which in turn has an embedded TV (Television) tuner 213A. The personal computer is also 

5 provided with application programs as a standard Ibr can-ying out editing, recording, reproduction as well as MPEG 
decoding of pictures and other picture processing. The MPEG1 real time encoder board 213 and the application pro- 
grams allow the editing of pictures and sound taken by a video camera 214, the creation of a video CD tor recording 
pictures and sound obtained as a result of the editing and other processing to be earned out with ease. In addition, a 
television broadcast program received by the TV tuner 21 3A can also be recorded with ease and other processing can 

10 be can^ied out easily as well. On the top of that, while a television broadcast program received by the TV tuner 21 3A is 
being recorded, any arbitrary scene of an already recorded video signal or pictures can be played back with ease. 

To put it in detail, a miaoprocessor 201 carries out editing, recording, reproduction as well as MPEG encoding of 
pictures and other predetermined picture processing by execution of a variety of application programs stored in the hard 
disc 212 under control of an operating system such as Windows 95 (trademark) made by Microsoft which is also stored 

15 in the hard disc 212. As the microprocessor 201 . the Pentium II processor of Intel with a frequency of 266 MHz and an 
embedded secondary cache menfK>ry of 512 KB not shown in the figure Is empk>yed. Tlie Pentium II processor is the 
Pentium Pro processor also made by Intel with an MMX technology and a facility to generate optimized 16-bit code 
added thereta Provided with such a processor, the personal computer is capable of displaying a high performance even 
when processing a large amount of picture and sound data. It should be noted that Pentium and MMX are trademarks. 

20 A main memory unit 202 is used for storing a program to be executed by the microprocessor 201 and data required 
in operations earned out by the microprocessor 201 . As a standard, the main memory unit 202 has a storage capacity 
of typically 32 MB which allows processing of, for example, a picture with a large amount of data to be carried out at a 
high speed. It should be noted that the storage capacity of the main memory unit 202 can be Increased up to typically 
128 MB by memory extension. 

25 A bus bridge 204 controls exchanges of data between an internal bus and an extension bus such as a PCI (Periph- 
eral Component Interconnect) local bus or an ISA (Industry Standard Architecture) bus. 

The miaoprocessor 201, the main memory unit 202 and the bus bridge 204 are connected to each other by the 
internal bus. On the other hand, the remaining blod^ are connected to each other by the extension bus. It shouki be 
noted that the bus bridge 204 Is connected to both the Internal bus and the extension bus. 

30 As a modem 206. a 33.6-Kbps (bits per second) DSVD/DATA/FAX modem is employed. The modem 206 controls 
communication through a telephone line. The modem 206 receives a picture and sound from a source such as the Inter- 
net to be subjected to processing such as encoding and editing. On the other hand, the modem 206 Is also capable of 
transmitting a picture and sourxl completing processing such as encoding and editing to an external destination. In 
addition, the modem 206 transmits sound input through the microphone 24 aixj receives incoming sound to output to 

35 the speakers 59 and 60, allowing a hands free phone to be implemented. It should be noted that, when the modem 206 
is used as a FAX nrxxlem, the transfer rate Is set at 1 4.4 Kbps. 

An I/O (input/output) Interface unit 207 generates an operation signal representing an operation candied out by the 
user on the keyboard 21 or the mouse 22. In addition, the I/O interiace unit 207 also functions as an interfece for receiv- 
ing an electrical signal as an audio signal output by the microphone 24. 

40 An auxiliary storage interface unit 210 functions as an interface of reading out and writing data from and onto 
recording media such as the CD-R (Compact Disc Recordable) disc 21 1 , a CD-ROM disc not shown in the figure, the 
HD (hard disc) 212 and an FD also not shown in the figure. 

On the CD-R disc 21 1 , pictures and sound encoded by the MPEG1 real time encoder board 21 3 is stored, allowing 
a user original video CD to be made. It shouki be noted that the CD drive 42 is also capable of handling a CD-R FS 

45 disc. Data of up to about 650 MB can be stored in the CD-R disc 21 1 whereas a CD-R FS disc is capable of storing data 
of up to only about 520 MB. 

The hard disc 212 has a typical storage capacity of 4.3 GB (gigabytes) which Is capable of keeping up with a high 
speed bus master IDE (Integrated Drive Electronics) transfer. The hard disc 212 is used for storing typically data 
obtained as a result of compression and encoding carried out by the MPEG1 real time encoder board 213 and data 
50 required in processing carried out by the microprocessor 201. It shoukJ be noted that the main unit 31 is designed to 
allow an SCSI (Small Computer System Interface) board to be installed therein. With the SCSI board Installed, a hard 
disc drive having an SCSI interface can be added. 

In addition, the hard disc 212 is also used for storing an operating system as well as software including Eipplication 
programs to be executed by the microprocessor 201 to can-y out processing such as recording, reproduction, editing 
55 and decoding of pictures. 

As an application program for the so-called video creation through processing such as recording, reproduction and 
editing of pictures, a software called Slipclip is installed. 

The Slipclip software comprises 5 application programs called as a Slip recorder, a dip editor, a clip viewer, a video 
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CD creator and a video CD copy tod. 

The slip recorder is executed to record a picture and sound or to play back a recorded picture and sound. The clip 
editor is executed to edit a recorded picture and its acconrpanying sound. The clip viewer is executed to administer 
recorded pictures and sound. A video CD creator is executed to record an edited picture or other data onto a CD-R disc 
5 21 1 in order to make a video CD. The video CD copy tool is executed to make a copy video CD of a video CD made 
earlier. 

It should be noted that, in the present embodiment, only a picture obtained as a result of editing work done in the 
main unit 31 can be copied in order to prevent a so-called pirate disc from being made illegally 

Among the slip recorder, the clip editor, the dip viewer, the video CD creator and the video CD copy tool, only the 
10 slip recorder, the dip editor and the clip viewer relate to recording, reproduction and editing of a picture In particular and 
will be explained one after another later. 

In the hard disc 212. there is further stored an application program to be executed by the microprocessor 201 to 
decode data encoded by the MPEG1 real time encoder board 213 typically in conformity with MPEG1 specifications. 
Thus, in this case, a picture is encoded by hardware and decoded by software. It should be noted that a picture can also 
15 be encoded by software and decoded by hardware. 

The encoder boaid 213. strictly speaking, the MPEG1 real time encoder board 213, encodes a picture and sound 
in a real time manner typically in conformity with the MPEG1 specifications. To be more specific, the MPEG1 real time 
encoder board 213 is capable of encoding a picture and sound in 4 different video recording modes including a mode 
of encoding at a high bit rate for high quality picture recording and a mode of encoding at a low bit rate for transmission. 
20 As will be described later, enumerated in an order of decreasing bit rates, the video recording modes are "High", "Nor- 
mal", "Long" and "Network". It should be noted that the normal video recording mode conforms to video CD specifica- 
tions. When pictures and sound are encoded in this video recording nxxle. recording of about 100 minutes per 1 GB 
can be canrled out. 

As described above, the MPEG1 real time encoder board 213 has an embedded TV tuner 213Afor receiving a tel- 
25 evision broadcast program. A program received by the TV tuner 21 3A Is subjected to MPEG encoding in the MPEG1 
real time encoder board 213. In addition, the MPEG1 real time encoder board 213 is also capable of encoding data sup- 
plied thereto by way of the extension bus. data supplied thereto by way of the AV processing drcuit 215 and data sup- 
plied thereto from an external apparatus such as the video camera 21 4. An example of data supplied thereto k>y way of 
the AV processing circuit 215 is a picture played back by the VTR 216. 
30 It should be noted that the TV tuner 21 3A allows typically 62 channels, from Channel 1 to Channel 62, to be 
selected. As for its audio facility, stereo and bilingual programs can be received. 

The video camera 214 is used typically for taking a picture to be supplied to the MPEG1 real time encoder board 
213. It should be noted that the MPEQ1 real time encoder board 213 also has a function for interfacing with the video 
camera 214, allowing a picture and sound taken by the video camera 214 to be supplied to the MPEG1 real time 
35 encoder board 213. 

The AV processing circuit 215 comprises conrponents induding a VGA (Video Graphic An^ay) and a 3-dimensional 
accelerator which are not shown in the figure. The AV processing circuit 215 carries out processing required for display- 
ing graphics and other information on the display apparatus 51. In addition, the AV processing circuit 215 also candies 
out processing required for outputting sound to the speakers 59 and 60. The AV processing circuit 215 has an embed- 

40 ded NTSC encoder 215A which is used for converting a picture into one conforming to the NTSC system before output- 
ting the picture to typically the VTR 216. 

The AV processing circuit 215 is connected to the MPEG1 real time encoder board 213 typically by an AMC bus. 
The MPEG1 real time encoder board 213 is designed so that a picture subjected to MPEG encoding Is once stored in 
a frame memory unit 1 1 0 shown In Fig. 6. The frame memory unit 1 1 0 will be described more later. When an instruction 

45 to rTX)nitor a picture subjeded to MPEG encoding is received, the picture is read out from the frame memory unit 110 
and supplied from the MPEG1 real time encoder board 213 to the AV processing circuit 215 by way of the AMC bus. 
The AV processing circuit 215 then displays the picture on the display apparatus 51 . 

To put it in detail, the AV processing circuit 215 draws a drawing on a VRAM (Video RAM (Random Access Mem- 
ory)) unit 203 and outputs the drawing to the display apparatus 51 . 

50 The VTR 216 records pictures and sound output by the AV processing circuit 215 if necessary 

Fig. 6 is a diagram showing a typical configuration of the MPEG1 real time encoder board 213 enrployed in the per- 
sonal computer shown in Fig. 5. It should be noted that Fig. 6 shows only blocks relating to MPEG encoding. Other 
blocks such as blocks constituting the TV tuner 21 3A are omitted from the figure. Speaking more strictly, Fig. 6 shows 
only blocks relating to MPEG encoding of a picture. Blocks relating to MPEG encoding of sound are also omitted from 

55 the figure. 

Digital picture data of 1 frame conrposed of a predetermined number of pixels is supplied to an input terminal 101 
at a typical transfer rate of about 30 frames per second. 

Picture data supplied through the input terminal 101 is temporarily stored in the memory frame unit 110 which is 
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capable of storing a plurality of frames of picture data, typically, 27 frames of picture data, so that the frames can be 
rearranged into a predetermined order. The picture data is then supplied to a block divider 1 1 1 and a motion detector 
120. The block divider 111 divides a frame of the picture data supplied from the memory frame unit 110 Into luminance 
components of typically 8x8 pixels and blocks of chroma components Cb and Cr. A macroblock (MB) comprises a total 

5 of 6 blocks, namely, 4 luminance component blocks and 1 Cb chroma component block as well as 1 Cr chroma compo- 
nent block which are associated with the 4 luminance component t)locks. 

The block divider 1 1 1 supplies the picture data to a subtractor 1 12 In macroblock units. The subtracter 1 1 1 com- 
putes a difference between the picture data supplied by the block divider 1 1 1 and interframe predicted picture data to 
be described later and supplies the difference to a switched terminal b of a change-over switch 1 1 3 as data of a frame 

10 subjected to interframe prediction encoding also to be described later. On the other hand, picture data output by the 
block divkJer 1 1 1 Is supplied to a switched terminal a of the change-over switch 1 13 as data of a frame subjected to 
intraframe prediction encoding also to be described later. 

The change-over switch 1 13 selects either the switched terminal a or b and picture data supplied to the selected 
switched terminal Is passed on to a OCT (discrete cosign transformation) circuit 1 14 in block units. The DCT circuit 114 

15 carries out DCT processing on picture data passed on thereto and outputs a DCT coefficient obtained as a result of the 
DCT processing to a quantizer 115. The quantizer 115 quantizes the DCT coefficient supplied thereto by the DCT circuit 
1 1 4 at a predetermined quantization step and outputs a quantized coefficient obtained as a result of the quantization to 
a zigzag scan circuit 116. 

The zigzag scan circuit 116 carries out zigzag scanning on quantized coefficients of each block and outputs the 

20 scanned coefficients to a VLC (Variable Length Code) circuit 1 1 7 in the scanning order. The VLC circuit 1 1 7 carries out 
VLC processing on the quantized coefficients supplied thereto by the zigzag scan circuit 116 and supplies variable 
length encoded data obtained as a result of the VLC processing to an output buffer 118. The output buffer 118 has a 
storage capacity of typically 1 60 KB. By temporarily storing the variable length encoded data received from the VLC cir- 
cuit 1 1 7, the output buffer 1 1 8 carries out a function of mainly smoothing of the amount of data to be output to an output 

25 terminal 1 02. Data appearing at the output terminal 1 02 is supplied typically to the hard disc 21 2 to be stored therein. 
In addition, the output buffer 118 also supplies information on the amount of data stored temporarily therein to a 
quantization step controller 1 1 9. The quantization step controller 1 1 9 sets the quantization step at such a value that nei- 
ther overflow nor underflow occurs in the output buffer 1 18 and outputs the value of the quantization step to the quan- 
tizer 115. As descrit>ed above, the quantizer 1 15 quantizes a DCT coefficient supplied thereto by the DCT circuit 1 14 

30 at a predetermined quantization step, that Is, a quantization step supplied by the quantization step controller 1 1 9. 

On the other hand, the quantizer 115 also supplies a quantized coefficient to an inverse quantizer 126 in addition 
to the zigzag scan circuit 1 16 described sibove. The inverse quantizer 1 26 canries out inverse quantization on the quan- 
tized coefficient supplied by the quantizer 1 15 and supplies a DCT coefficient obtained as a result of the inverse quan- 
tization to an inverse DCT circuit 125. The Inverse DCT circuit 125 carries out inverse DCT processing on the DCT 

35 coefficient and outputs data obtained as a result of the inverse DCT processing to an adder 124. Also supplied to the 
adder 124 is Interframe predicted picture data supplied by a motion compensator 121 by way of a turned on change- 
over switch 123 which Is turned on when a frame subjected to interframe prediction encoding is processed. The adder 
124 adds the data output by the inverse DCT circuit 125 to the interframe predicted picture data supplied by the nxstion 
compensator 121 and outputs the sum to a frame memory unit 122. 

40 The motion compensator 121 compensates data stored In the frame memory unit 122 for a motion in accordance 
with a motion vector output by the motion detector 120. Interframe predicted picture data obtained as a result of the 
compensation is supplied to the subtractor 1 12 as described earlier and the change-over switch 123. 

Frames composing a picture, strictly speaking, a nxsving picture, to be encoded are an^anged in a display order 
starting with the head as follows: 10. B1, B2, P3. B4. B5, P6, B7, B8, 19. B10. B11, B12, — . The symbols I. P and B 

45 indicate that frames denoted thereby are an I picture, a P picture and a B picture respectively and a number appended 
to a symbol indicates a position in the display order. 

In the MPEG system, first of all. a picture 10 is encoded. Then, a picture P3 is supposed to be encoded. In this case, 
however, instead of encoding the picture P3 itself, a difference between the pictures P3 and 10 is encoded. Subse- 
quently, a picture B1 is supposed to be encoded, however, instead of encoding the picture B1 itself, a difference 

50 between the pictures B1 and 10 or P3 or a difference between the picture B1 and an average of the pictures 10 and P3 
is encoded. In this case, one is selected among the picture 10, the picture P3 and the average of the pictures 10 and P3 
so that a so-called predicted residual obtained as a result of the encoding Is minimum. That is to say, the encoding of a 
difference between the picture B1 and the selected one results in data with a minimum amount. 

After the encoding of the picture B1 . a picture B2 is supposed to be encoded, however, Instead of encoding the pic- 

55 ture B2 itself, a difference between the pictures B2 and 10 or P3 or a difference between the picture B2 and an average 
of the pictures 10 and P3 is encoded. In this case, one is selected among the picture 10, the picture P3 and the average 
of the pictures 10 and P3 so that the so-called predicted residual obtained as a result of the encoding of a difference 
between the picture B2 and the selected one results In data with a minimum annount. 
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Subsequently, a picture P6 is supposed to be encoded, however, instead of encoding the picture P6 itself, a differ- 
ence between the pictures P6 and P3 is encoded. Thereafter, encoding is can-ied out by following the same procedure. 

A picture supposed to be encoded and a partner picture whose difference from the picture supposed to be encoded 
is actually encoded form a pair. Such pairs are listed in the following table in an encoding order. 



Encoding order 


Picture to be encoded 


Partner picture 


1 


10 




2 


P3 


10 or r3 


3 


B1 


10 or P3 


4 


B2 


10 or P3 


5 


P6 


P3 


6 


B4 


P3 or P6 


7 


B5 


P3 or P6 


o 
o 


Pd 


P6 


9 


B7 


P6 or P9 


10 


B8 


P6 or P9 


11 


19 




12 


P12 


19 


13 


BIO 


19 or PI 2 


14 


B11 


19 or P12 



As Shown in the above table, the encoding order is 10. P3. B1, B2. P6. B4. B5. P9. B7. B8. 19. P12. BIO. B1 1 . — 
and. thus, different from the display order. Data after the encoding is output in such an order. 

It should be noted that, in the case of a P picture or a B picture, as described above, it is normal to encode a differ- 
ence between the P picture or the B picture from another picture. If the amount of data obtained as a result of the encod- 
ing of the picture itself is smaller than that obtained as a result of encoding the difference, nevertheless, the picture itself 
is encoded. 

In the MPEG1 real time encoder board 213 shown in Fig. 6, encoding is carried out as described above. 

Thus, in an operation to encode the first picture 10. data of the picture Is read out from the frame memory unit 1 1 0 
and supplied to the block divider 1 1 1 to be divided into blocks. To be more specific, the data of the picture is divided by 
the block divider 111 in a blocking process into the 4 luminance blocks and the Cb and Cr chrominance blocks 
described earlier which are output sequentially one block after another. In an operation to encode an i picture, the 
change-over switch 1 13 is set at the switched terminal a. Thus, picture data output by the block divider 1 1 1 is supplied 
to the OCT circuit 1 14 by way of the change-over switch 1 13. In the DCT circuit 114. picture data supplied thereto in 
block units is subjected to vertical horizontal 2 dimensional DCT processing. As a result, picture data on the time axis 
is converted into DCT coefficients of data on a frequency axis. 

The quantizer 1 15 quantizes a DCT coefficient supplied thereto by the DCT circuit 1 14 at a quantization step deter- 
mined by the quantization step controller 119 and outputs a quantized coefficient obtained as a result of tiie quantiza- 
tion to the zigzag scan circuit 1 16. The zigzag scan circuit 1 16 carries out zigzag scanning on quantized coefficients of 
each block and outputs tiie scanned coefficients to the VLC circuit 1 17 in tiie scanning order. 

The VLC circuit 117 carries out variable length coding processing such as Huffman coding on the quantized coef- 
ficients supplied thereto by tiie zigzag scan circuit 1 16 and supplies variable length encoded data obtained as a result 
of tiie variable lengtii coding processing to the output buffer 118 to be stored tiierein temporarily. Then, tiie variable 
length encoded data is output by the buffer 1 18 at a fixed bit rate. Thus, tiie output buffer 118 plays tiie role of a so- 
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called buffer memory allouving data generated irregularly to be output at a fixed bit rate. 

A& desaibed above, the picture 10, an I (Intra) picture, Is encoded alone without Involving other pictures in the 
encoding. Such encoding of a picture alone without involving other pictures is referred to hereafter as Intraframe encod- 
ing. It should be noted that a picture completing Infraframe encoding Is decoded in accordance with a reversed proce- 
5 dure opposite to the procedure described above. 

Next, the encoding of the second picture P3 is described. The second arKi subsequent pictures can also be 
encoded as an I picture. By doing so, however, the compression ratio of the encoding will be low. In order to solve this 
problem, utilizing the lacX that correlation anrK)ng consecutive pictures exists, the second and subsequent pictures are 
encoded as follows. 

10 The motion detector 120 detects a portion of the first picture 10 that well resembles one of macrot>locKs composing 
the second picture P3 for each of the nr^croblocks. A vector representing a shift in positional relation between a mac- 
roblock and a portion that well resembles the macroblock Is detected as a motion vector. Described in documents such 
as the ISO/ISC 1 1 172-2 annex D.6.2, the method of detecting a motion vector is not described In this specification. 
As for the second picture P3. instead of supplying its blocks to the DOT circuit 1 1 4 as they are, a difference between 

15 a P3 block and a block obtained from the first picture 10 as a result of motion compensation carried out by the motion 
compensator 121 in accordance with a motion vector of the block Is computed by the subtracter 1 12 for each block and 
supplied to the DCT circuit 114 by way of the change-over switch 1 13. 

In this case, if the correlation between a block obtained as a result of motion compensation of the first picture 10 in 
accordance with a motion vector and a block of the second picture P3 is good, the difference between the blocks is 

20 small. In this case, the amount of data obtained as a result of encoding the difference is smaller than the amount of data 
obtained as a result of Irrtraframe encoding of a block of the second picture P3. 

The technique of encoding a difference between blocks is refen-ed to hereafter as interframe encoding. 
It should be noted, however, that the amount of data obtained as a result of Interframe encoding of a difference 
between 2 tslocks is not always smaller than the amount of data obtained as a resutt of intraframe encoding. Depending 

25 on the complexity of a picture being encoded and the degree of con-etation between a frame and an immediately pre- 
ceding frame, the amount of data obtained as a result of interframe encoding of a difference between 2 blocks may be 
adversely larger than the amount of data obtained as a result of intraframe encoding, resulting in a higher compression 
ratio for the latter encoding. In such a case, the intraframe encoding is preferred and implemented instead. A decision 
as to whether interframe encoding or intraframe encoding is to be carried out can be made for each macroblock. 

30 By the way. in order to can-y out interframe encoding, that is, in order to find a difference between a current picture 
and the picture immediately preceding the current picture, it is necessary to find in advance a locally decoded immedi- 
ately preceding picture obtained k>y locally decoding encoded data of the immediately preceding picture which has teen 
encoded previously as will be desaibed below. 

For this reason, the MPEG1 real time encoder board 213 Is provided with the so-called local decoder which com- 

35 prises the motion compensator 121, the frame memory unit 122, the change-over switch 123, the adder 124. the 
inverse DCT circuit 1 25 and the inverse quantizer 1 26. It should be noted that picture data stored in the frame memory 
unit 122 is called a local decoded picture or local decoded data. On the other hand, picture data before coding is called 
an original picture or original data. 

tn an operation to encode the first picture 10, data output by the quantizer 1 1 5 is also locally decoded by the inverse 

40 quantizer 126 in conjunction with the inverse DCT circuit 125. In this case, the change-over switch 123 is turned off, 
causing the locally decoded data to be passed on by the adder 1 24 as it is to the frame menrary unit 1 22. That is to say, 
with the change-over switch 1 23 turned off. the adder 1 24 in essence does not carry out addition on the locally decoded 
data. 

It shouki be noted that the picture data stored in the frame memory unit 122 is not an original picture but a picture 
45 obtained as a result of encoding the original picture and then locally decoding data obtained as a result of the encoding 
of the original picture. Thus, the picture data stored in the frame memory unit 122 is the same as a picture obtained as 
a result of decoding carried out by a data decoding apparatus. Obtained as a result of encoding the original picture and 
then locally decoding data obtained as a result of the encoding of the original picture, the picture data stored in the 
frame memory unit 122 has a picture quality poorer than the original data to a certain degree. 
50 With locally decoded data of the first picture 10 stored in the frame memory unit 122. the second picture P3 is sup- 
plied from the frame memory unit 1 10 to the subtracter 1 12 by way of the t^lock divider 1 1 1 in block units. It should be 
noted that by this point of time, it is necessary to end the detection of motion vectors of the picture P3 earned out by 
the motion detector 120. 

On the other hand, the nxition detector 120 supplies a motion vector detected for each macrok)lock of the second 
55 picture P3 to the rxK^on compensator 1 21 . The motion compensator 1 21 carries out MC (motion compensation) on the 
already locally decoded picture 10 stored in the frame memory unit 122 in accordance with a motion vector supplied by 
the motion detector 120. 1 macroblock of MC (nnotion compensation) data obtained as a result of the motion compen- 
sation is supplied to the subtracter 1 12 as interframe predicted picture data. 
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The subtractor 112 computes a difference between the original data of each pixel off the picture P3 supplied thereto 
through the block divider 1 1 1 and the corresponding pixel of the Interframe predicted picture data supplied by the 
motion compensator 121 for each pixel. The difference computed by the subtractor 1 12 is supplied to the DOT circuit 
1 14 by way of the change-over switch 1 13. Thereafter, the difference is subjected to encoding in the same way as an t 
5 picture. Thus, in this case, the change-over switch 1 13 is set to the switched terminal b. 

As described above, in the case of a P (predicted) picture, that is. in the case of the picture P3 in the above exam- 
ple, basically, an I or P picture encoded right before is used as a reference picture to which motion compensation is 
applied to produce a predicted picture, and a difference between the predicted picture and the P picture is then 
encoded. 

10 That is to say. in the case of a P picture, for a macroblock, strictly speaking, an interframe macroblocK for which the 
amount off data obtained as a result of Interframe encoding is smaller than that obtained as a result off intraframe encod- 
ing, the change-over switch 1 13 is set to the switched terminal b in order to implement the interframe encoding. For a 
macroblocK strictly speaking, an intraframe macroblocK. for which the anrtount off data obtained as a result of intraframe 
encoding is smaller than that obtained as a result of interframe encoding, on the other hand, the change-over switch 

IS 1 13 is set to the switched terminal a in order to implement the intraframe encoding. 

It should be noted that a macroblock of a P picture that has completed intraframe encoding is locally decoded and 
the locally decoded data is stored in the frame memory unit 122 in the same way as an I picture. On the other hand, a 
macroblock of a P picture that has completed interframe encoding is locally decoded by addition of data passing 
through the inverse quantizer 126 and the inverse DCT circuit 125 to interframe predicted picture data from the motion 

20 compensator 1 21 passed on by the turned-on change-over switch 1 23 by means of the adder 1 24. The locally decoded 
data output of the adder 124 is then stored in the frame memory unit 122. 
Next, encoding of the third picture B1 is explained. 

In an operation to encode a B picture, namely, the picture 81 in this case, the motion detector 120 detects 2 motion 
vectors with respect to an I or P picture displayed right before and an I or P picture displayed right after. Thus, in this 
25 example, 2 nriotion vectors off the picture 81 with respect to the pictures 10 and P3 are detected. The motion vector with 
respect to the picture 10. an I picture displayed right before the picture 81 . is referred to as a forward vector. On the other 
hand, the motion vector with respect to the picture P3. an P picture displayed right after the picture 81 , is referred to as 
a backward vector. 

The picture 81 is encoded by encoding one selected from the following 4 pieces of data which will result in a small- 
30 est amount off encoded data. The 4 pieces of data are: 

1 A difference between the picture B1 and interframe predicted picture data obtained as a result of motion compen- 
sation of the locally decoded picture 10 according to the forward vector. 

2 A difference between the picture 81 and interframe predicted picture data obtained as a result of motion compen- 
35 sation of the locally decoded picture P3 according to the backward vector. 

3 A difference t)etween the pictured 81 and the average of the 2 pieces of interframe predicted picture data in 1 and 
2. 

4 The picture 81 itself. 

40 When difference 1. 2 or 3 is encoded, that is. when interframe encoding is carried out. necessary motion vectors 
are supplied by the motion detector 120 to the nxstion compensator 121 . Interframe predicted picture data obtained as 
a result of motion compensatron carried out by the motion compensator 121 according to the motion vector is supplied 
to the subtractor 1 12 which then computes the difference between the original data of the picture 81 and the interframe 
predicted picture data supplied by the motion compensator 121 . The difference is supplied to the DCT circuit 1 14 by 

45 way of the change-over switch 113. Thus, in this case, the change-over switch 113 is set to the switched terminal b. 
When data 4 of the picture 81 itself is encoded, that is. when intraframe encoding is carried out, on the other hand, the 
data, that is. the original data of the picture 81 , is supplied to the DCT circuit 1 1 4 by way of the change-over switch 113. 
Thus, in this case, the change-over switch 1 13 is set to the switched terminal a. 

In the operation to encode the picture 81 , which is a 8 picture, the pictures 10 and P3 have already been encoded. 

50 then locally decoded and finally stored in the frame memory unit 122. Thus, the encoding can be implemented. 

The fourth picture 82 is encoded in the same way as the picture 81 . That is to say, the desaiption off the encoding 
of the picture 81 given so far is applicable to the picture 82 provided that the symbol 81 in the desaiption is replaced 
by the symbol 82. 

The fifth picture P6 is encoded in the same way as the picture P3. That is to say, the description off the encoding of 
55 the picture P3 given so far is applicable to the picture P6 provided that the symbols P3 and 10 in the description are 
replaced by the symbols P6 and P3 respectively. 

The sixth and subsequent pictures are encoded by repeating the encoding process described above. It is thus not 
necessary to repeat the description. 
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By the way. the MPEQ1 real time encoder board 213 determines the picture type of a picture of each screen to be 
encoded, that is. whether the picture to be encoded is an I, P or B picture, and determines the macro block type of a 
macroblock of each picture to be encoded In accordance with the amount of data which will obtained as a result of the 
encoding as described above. However, the amount of data depends on the picture to be encoded and is thus not 
5 known accurately unless the encoding is actually carried out. 

By the way, it is basically necessary to set the bit rate of a bit stream obtained as a result of MPEG encoding at a 
fixed value. As a method of keeping the bit rate at a fixed value, for example, there is a technique of controlling the quan- 
tization step (the quantization scale) used in the quantizer 115. To put It in detail, at a large quantization step, data is 
quantized coarsely, resulting a small amount of generated data or generated code. At a small quantization step, on the 
10 other hand, data is quantized finely, resulting a large amount of generated data or generated code. 

The quantization step is controlled in concrete terms as follows. 

At the output stage of the MPEG1 real time encoder board 213, the output buffer 1 1 8 is provided. The output buffer 
1 18 is used for temporarily storing encoded data to absoib changes in amount of generated data to a certain degree. 
As a result, the bit rate of an output bit stream can be made constant. 

IS If generation of encoded data, strictly speaking, variable length encoded data, at a bit rate higher than a predeter- 
mined value continues, however, the amount of data stored in the output buffer 1 1 8 will keep increasing, resulting In an 
overflow eventually. If generation of encoded data, strictly speaking, variable length encoded data, at a bit rate lower 
than a predetermined value continues, on the other hand, the amount of data stored in the output buffer 1 18 will keep 
decreasing, resulting in an underflow eventually. 

20 In order to solve the problem described above, the amount of data or code stored in the output buffer 118 is fed 
back to the quantization step controller 1 1 9 which controls the quantization step in accordance with the amount of data 
or code fed back thereto so as to prevent an overflow and an underflow from occurring in the output buffer 118. 

To put it in detail, when the amount of data or code stored in the output buffer 1 18 approaches the storage capacity 
of the output buffer 1 1 8. leading to a state in which an overflow is about to occur imminently, the quantization step con- 

25 troller 119 increases the quantization step In order to decrease the amount of data generated by the quantizer 115. 
When the amount of data or code stored In the output buffer 1 1 8 approaches 0. leading to a state in which an underflow 
is about to occur imminently, on the other hand, the quantization step controller 1 1 9 decreases the quantization step in 
order to increase the amount of data generated by the quantizer 115. 

By the way. the amount of generated code also varies in dependence on whether a picture is encoded by using the 

30 intraframe or interframe encoding technique. 

In general, since intraframe encoding results in a relatively larger amount of generated code, it is necessary to set 
the quantization step at a very large value when the amount of data stored In the output buffer 1 1 8 is large. In this case, 
nevertheless, an overflow may occur in the output buffer 1 1 8 anyway even if the quantization step is inaeased to a max- 
imum value. In addition, when quantization is can-ied out at a large quantization step, basically, the quality of the 

35 decoded picture deteriorates and the quality of a picture encoded and decoded with the decoded picture taken as a ref- 
erence picture also deteriorates as well. Thus, when infraframe encoding isi carried out, it is necessary to preserve a 
sufficiently large free area in the output buffer 1 1 8 in order to prevent an overflow from occun^lng in the output buffer 1 1 8 
arxJ to prevent the quality of a decoded picture from deteriorating. 

For that reason, the quantization step controller 1 1 9 recognizes an order in which intraframe or interframe encoding 

40 is to be carried out in advance from a signal supplied thereto by the compression technique selecting circuit 132. The 
quantization step controller 1 1 9 controls the quantlzatton step so as to preserve a sufficiently large free area in the out- 
put k}uffer 1 18 in the case of intraframe encoding. 

By the way. from the decoded picture quality point of view, quantization needs to be carried out at a small quanti- 
zation step for a complicated picture or a large quantization step in the case of a sinrple picture. In the quantization step 

45 set only on the basis of information fed back from the output buffer 118, however, such a quantization requirement is 
not taken into consideration. If the quantization step is set at a value which is improper from the picture complexity point 
of view, an excessively large or small number of bits will be allocated. If an inappropriate number of bits are allocated 
to a certain picture, the number of bits allocated to another picture will be affected, resulting in an undesirable state. 
In order to solve this problem, the quantization step controller 119 sets the quantization step at a value based on 

50 by not only the fed back amount of data stored in the output buffer 1 1 8 in the buffer feecfeack control but also the com- 
plexity of a picture subjected to encoding. 

To put it in detail, a picture evaluating circuit 130 errployed in the MPEQ1 real time encoder board 213 reads out 
data of a picture to be encoded from the frame memory unit 110, conputing an evaluation value to be used as an indi- 
cator of the complexity of the picture. The picture evaluating circuit 130 then outputs the evaluation value to a scene 

55 change detecting circuit 131 , the compression technique selecting circuit 132 and the quantization step controller 119. 
The quantization step controller 1 19 learns the relation anrK)ng a quantization step actually used in the encoding of 
a picture, the amount of data or code obtained as a result of the quantization carried out at the quantization step and 
an evaluation value indicating the conrpiexity of the picture from the picture evaluating circuit 130 and. from a result of 
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the learning process, finds a basic quantization step used as a base for setting a next quantization step. 

To put it in detail, the quantization step controller 1 1 9 performs a regression analysis using a quantization step actu- 
ally used in the encoding of a picture, the amount of data or code obtained as a result of the quantization carried out at 
the quantization step and an evaluation value indicating the complexity of the picture and learns the relation among 
them from a graph representing results of the analysis. Subsequently, a basic quantization step which is optimum for 
encoding a next picture is predicted from the graph with an evaluation value indicating the complexity of the next picture 
to be encoded taken as a parameter. 

Then, tiie quantization step controller 119 changes the basic quantization step in accordance with information fed 
back from the output buffer 1 1 8 and sets the nrxxjif led value as a quantization step. 

A basic quantization step can be predicted from tine learning process witii a high degree of accuracy by taking the 
complexity of a picture into consideration. Thus, by finding a quantization step from such a basic quantization step, the 
quality of a decoded picture can be improved in comparison witii a picture obtained as a result of controlling tiie quan- 
tization step only on tiie basis of infonnation fed back from tiie output buffer 118. 

It should be noted that the scene change detecting circuit 131 detects whetiier or not the scene changes from an 
evaluation value supplied tiiereto by the picture evaluating circuit 130. A result of the detection is supplied to tiie com- 
pression technique selecting circuit 132. The compression technique selecting circuit 132 selects a technique of com- 
pressing a picture in accordance with an evaluation value supplied thereto by the picture evaluating circuit 130 and, if 
necessary, the result of detection output by tiie scene change detecting circuit 1 31 . To put it In detail, tiie compression 
technique selected by the compression technique selecting circuit 132, for example, determines tiie I, P or B picture as 
a picture type of a picture to be encoded, determines the number of pictures composing a GOP and determines a mac- 
roWock type, that is. whether a macroWock Is subjected to infraframe or interframe encoding. 

After selecting a compression technique, the compression technique selecting circuit 132 controls tiie change-over 
switches 113 and 123 in dependence on whether a current macroblock is subjected to intraframe or interframe encod- 
ing. To be more specific, in the case of a macroblock subjected to intraframe encoding, tiie change-over switch 1 13 is 
set to the switched terminal a and the change-over switch 123 is turned off. In the case of a maaoblock subjected to 
interframe encoding, on tiie other hand, the change-over switch 1 13 is set to tiie switched terminal b and the change- 
over switch 123 is turned on. 

In addition, tiie compression technique selecting circuit 132 notifies tiie quantization step controller 1 19 of either 
the intraframe encoding technique or the interframe encoding technique which is selected thereby. The encoding tech- 
nique is used by the quantization step controller 1 19 to recognize an order in which the intraframe encoding and the 
interframe encoding are candied out. 

If the compression technique selecting circuit 132 has been consecutively selecting the P or B picture as a picture 
type of consecutive pictures to be encoded for a long time, if a picture witii a low correlation between frames caused by 
a scene change an^ives, the amount of generated data increases and the quality of a decoded picture deteriorates 
because, a P or B picture is basically encoded by using the interframe encoding technique. 

In order to solve the problem described above, tiie scene change detecting circuit 131 supplies a result of detection 
of a scene change to tiie compression technique selecting circuit 132. When tiie conrpression technique selecting cir- 
cuit 1 32 is informed of a scene change, tiie I picture is selected as a picture type of a picture following the scene change 
in a process called a forced selection. 

It shoukl be noted tiiat tiie metiiod, whereby a basic quantization step is inferred from a learning process and a 
quantization step is set from the learned basic quantization step as desaibed above, is described in detail in docu- 
ments such as Japanese Patent Laid-open No. Hei8- 102951 submitted earlier by the patent applicant. 

The pictijre evaluating circuit 130 computes the following 2 parameters representing the complexity of a picture as 
evaluation values to be used for evaluation of a picture subjected to encoding by referencing the frame memory unit 
110. 

To put It in detail, as a first parameter, an evaluation value representing tiie amount of information of a picture itself 
is calculated. With the first parameter, the arrwunt of code obtained as a result of intraframe encoding of the picture, 
that is, tiie amount of code obtained as a result of encoding of tiie picture as an I picture, can be predicted (or inferred). 
To put it concretely, as a typical first parameter, a sum of DOT coefficients each obtained from DCT processing of a 
block of a picture or anotiier statistical quantity can be used. As a typical alternative, an average of pixel values for a 
block is computed. Then, a sum of the absolute values of differences between the average and tiie pixel values is found. 
The sum is referred to as a mean absolute difference for the sake of convenience. Then, a sum of mean absolute dif- 
ferences for all blocks can also be used as anotiier typical first parameter. It should be noted that, in tiie case of tiie 
other typical first parameter found by calculating a sum of mean absolute differences, the size of the picture evaluating 
circuit 130 can be made relatively small and. hence, tiie load can be reduced to a relatively small one in comparison 
witii the typical first parameter found by calculating a sum of DCT coefficients. 

For the reason described above, in the picture evaluating circuit 130. a sum of mean absolute differences for all 
blocks is found as a first parameter as follows. 
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To put it in detail, new consider, for example, a block S of a picture subjected to encoding. Let Sj j be a pixel value 
of a pixel at a position on the ith column to the right from the leftmost top corner of the block S and the jth row down 
from the corner. The MAD (Mean Absolute Difference) for the block S is found by Eq. (1) given below. Even though the 
equation can be applied to all luminance and chrominance blocks, the MAD is typically calculated for each luminance 
5 block only 

8 8 

Z|S|J-SaveI (1) 

10 

where notation Save used in Eq. (1) is an average of pixel values for the block S. 

Then, a sum SM AD of mean absolute differences M ADs for all blocks is confuted as a first parameter by using Eq. 
(2) as follows: 

IS SMAD - E MAD (2) 

where the symbol £ used in Eq. (2) indicates summation of mean absolute differences MADs for all blocks composing 
the picture. 

It should be noted that, in the picture evaluating circuit 130, the mean absolute difference MAD expressed by Eq. 
20 (1) can also be found as a sum for a macroblock instead of a block. Such a mean absolute difference is typically used 
by the compression technique selecting circuit 132 in determination of whether the maaoblock is to be encoded using 
the intraframe encoding technique or the interframe encoding technique and, in the case of the interframe encoding 
technique, selection of fonvard prediction encoding, backward prediction encoding or both fonward and backward pre- 
diction encoding. 

25 As a second parameter, an evaluation value representing the amount of information on a difference between a pic- 
ture and a reference picture used in interframe encoding of the picture is computed. With the second parameter, the 
amount of code obtained as a result of Interframe encoding of the picture can be predicted. To put it concretely, as a 
second parameter, a sum of the absolute values of differences between, for example, a picture and a predicted picture 
is found for each block. The sum is referred to as a mean absolute difference for the sake of convenience. A predicted 

30 picture is a picture obtained from motion compensation of a reference picture. Then, a sum of mean absolute differ- 
ences for all blocks is used as a second parameter. 

A mean absolute difference is found when a motion vector Is detected by the nnotion detector 120. Then, in the pic- 
ture evaluating circuit 130, as a second parameter, a sum of mean absolute differences is typically found by using 
results of motion detection carried out by the motion detector 1 20. 

35 To put it in detail, now, consider, for example, a block of a reference picture. The block comprises 8X8 pixels. Let 
Rj j be a pixel value of a pixel at a position on the ith column to the right from the leftmost top corner of the block and the 
jth row down from the corner. Also consider an x axis in the horizontal direction and a y axis in the vertical direction for 
a picture to be encoded. In a block with a leftmost top pixel thereof coincKling with a point (x, y), let Sx4.j, y4.j be a pixel 
value of a pixel at a position on the ith column to the right from the leftmost top corner of the block and the jth row down 

40 from the corner. 

In the motion detector 120, a sum d (x, y) of the absolute values of differences between the pixel values Sx+I, y+j 
and Rij expressed by Eq. (3) is found by incrementing the subscripts i and j each by 1 at a time. 

8 8 

^ d(x.y)-£2:iSx.i.y.j-Rgl (3) 

i-1 J-1 



In the motion detector 120. coordinates (x, y) that minimize the sum d (x. y) of Eq. (3) is detected as a motion vector 
50 and the minimum d (x, y) is found as an absolute difference AD. 

Then, in the picture evaluating circuit 130, a sum SAD of absolute differences ADs each found in the motion detec- 
tor 120 for a block is computed as a second parameter by using Eq. (4) expressing summation for all blocks as follows: 



55 



SAD = S AD (4) 

where the symbol £ used in Eq. (4) indicates summation of absolute differences ADs for all blocks composing the pic- 
ture. 

It shoukJ be noted that, in the picture evaluating circuit 130, the absolute difference AD expressed by Eq. (3) can 
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also be found as a sum for a maaoblock instead of a block. Such an absolute difference is typically used by the com- 
pression technique selecting circuit 132 in determination of whether the macroblock is to be encoded using the infra- 
frame encoding technique or the interframe encoding technique and. in the case of the interframe encoding technique, 
selection of fonivard prediction encoding, backward prediction encoding or both forward and backward prediction encod- 
ing. 

The first parameter SMAD and the second parameter SAD found by the picture evaluating circuit 130 are supplied 
to the scene change detecting circuit 131, the compression technique selecting circuit 132 and the quantization step 
controller 119. 

As described above, the scene detecting circuit 131 detects the occurrence of a scene change on the basis of the 
evaluation values output by the picture evaluating circuit 130. The compression technique selecting circuit 132 selects 
a technique of compressing a picture in accordance with the evaluation values supplied thereto by the picture evaluat- 
ing circuit 130 and, if necessary, the result of detection output by the scene change detecting circuit 131. The quantiza- 
tion step controller 119 sets a quantization step as described above. 

It should be noted that, in the scene change detecting circuit 1 31 , a ratio of the second parameter SAD of a picture 
to the second parameter SAD of a picture immediately succeeding the picture is found. The magnitude of the ratio is 
used as a criterion as to whether or not the scene has changed. 

In addition, the scene change detecting circuit 1 31 also generates index data to be described later. The index data 
is supplied to the microprocessor 201 to be stored in a generated index file also to be described later. 

In the compression technique selecting circuit 132, for a P or B picture for example, the total mean absolute differ- 
ence MAD and the total absolute difference AD for a macroblock supplied thereto by the picture evaluating circuit 130 
are compared with each other and the outcome of the comparison is used to make a decision as to whether the mac- 
roblock Is to be encoded by using the intraframe or interframe encoding technique. To put it in detail, if the total mean 
absolute difference MAD for a macroblock is found smaller than the total absolute difference AD for the macroblock, that 
is. if the amount of code obtained as a result of intraframe encoding is predicted to be smaller than the amount of code 
obtained as a result of interframe encoding, the intraframe encoding is selected. If the mean absolute difference AD for 
a macroblock is found smaller than the total mean absolute difference MAD for the macroblock. that is. if the amount of 
code obtained as a result of interframe encoding is predicted to be smaller than the amount of code obtained as a result 
of intraframe encoding, the interframe encoding is selected. 

It should be noted that, in the MPEG1 real time encoder board 213 shown in Rg. 6, the controller 133 monitors the 
amount of data stored in the output buffer 118 and controls the encoding process in the MPEG1 real time encoder 
board 213 in accordance with the amount of data as will be described later. 

The following is a description of Slipclip. a set of 5 application programs stored in the hard disc 212 for video crea- 
tive work. 

When the power supply of the main unit 31 is turned on by the user by operating the power supply button 34, the 
operating system stored in the hard disc 212, namely, WirKlows 95 cited earlier, is activated. When a start button of a 
task bar thereof is clicked, a start menu is displayed. 

In this embodiment, as an item of the start menu, typically "VAIO" is displayed. In the "VAIO" item, predetermined 
application programs including Slipclip are cataloged. 

As described above, the Slipclip software comprises 5 application programs called the slip recorder, the clip editor, 
the clip viewer, the video CD creator and the video CD copy tool which are all cataloged in Slipclip of "VAIO". Thus, 
when the "Slipclip" item is clicked by operating the mouse 22, 5 items representing the 5 application programs, namely. 
" slip recorder", "dip editor", "dip viewer", "vWeo CD aeator" and "video CD copy tool" are displayed on the screen. 

The user then clicks one of the items in accordance with the purpose of the job to invoke an application program 
corresponding to the clicked item. 

When a photographic material to be used in aeation of a video CD is taken by means of the video camera 21 4 and 
recorded on a recording medium, the slip recorder is activated if the photographic nf\aterial is recorded in a simple way 
as is the case with recording of a television broadcast program by using a recording apparatus such as the WR 216. 
In this case, a slip recorder main window 301 like one shown in Fig. 7 is displayed. 

As shown in the figure, the sI^d recorder main window 301 comprises a variety of indicator and display fields and 
buttons. 

To put it in detail, on a recording indicator field 302. recording status is displayed. To put it concretely, for status of 
waiting for the start of a recording operation after a recording reservation, typically the word "TIMER" is displayed on 
the recording indicator field 302. For status of carrying out a reserved recording operation, typically the words "TIMER 
REC" are displayed on the recording indicator field 302. If a recording operation is started by operating a recording but- 
ton 309. typically the word "REC" is displayed on the recording indicator f ieki 302. If a recording operation is temporarily 
halted by operating a pause button 31 0 or halted by operating a stop button 308, typically the word "PAUSE" or the word 
"STOP" respectively is displayed on the recording indicator field 302. 

A scene change indicator field 303. which has a shape resembling a flag, is displayed only when the occurrence of 
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a scene change on a picture being recorded is detected. In other words, normally, the scene change indicator field 303 
is not displayed. If a scene change is detected, the scene change indicator field 303 is displayed for a fixed period of 
time to notify the user of the occurrence of the scene change. 

On a present time display field 304, the present time is displayed on a so-called 24-hour basis. The present time 
5 display field 304 displays typically the time controlled by "date and time" of a control panel of Windows 95 as It is. 

On a recording time display field 305, time information such as a time lapse since the start of a recording operation, 
a remaining time to the end of the recording operation or a remaining period of time till the end of a tape to be described 
later is displayed. By operating a time button 311, that is, a recording time display change button, the user can select 
which time information is to be displayed on the recording time display field 304. It should be noted that, if a recording 
10 operation is not being carried out, typically "00 : 00 : 00" Is displayed on the recording time display field 305. 

On a timer standby indicator field 306, the status of a reservation recording operation is displayed. When a record- 
ing reservation is made, putting the status in a state of waiting for the start of the reservation recording operation, for 
exanrple, the start time of the reservation recording operation is displayed on the timer standby indicator field 306 to 
Indicate the status of waiting for the start of the reservation recording operation. To put it concretely, when the present 
15 Status is status of waiting for a reservation recording operation which will start at 14:55. for example, the word "ON" is 
displayed to indicate the status of waiting for a reservation recording operation and the time "14 : 55" is displayed to 
indicate that the reservation recording operation will start at 1 4 : 55 as shown in Fig. 7. Status of presently carrying out 
a reservation recording operation is also displayed along with an end time of the reservation recording operation. To put 
It concretely, for example, status of presently carrying out a reservation recording operation which will end at 21 : 43 is 
20 indicated by the word "OFF" and the time "21 : 43" displayed on the timer standby indicator field 306. 

It should be noted that, in the case of a recording operation other than a reservation recording operation which is 
refered to hereafter simply as ordinary recording for the sake of convenience, a message identical with that for irxllcat- 
ing that the ordinary recording is under way Is displayed even if the end time has been set. 

Status of can-ying out an ordinary recording operation with no end time set is indicated by "- : --". for example, dis- 
25 played on the timer standby indicator field 306. 

For operations other than the reservation and ordinary recording operations, nothing is displayed on the timer 
standby Indicator field 306. 

On an erxJjess recording display field 307A, a message indicating a type of a tape to be described later is displayed. 
In tiie case of an "endless" tape type, the character "E" is displayed on the endless recording display field 307A as 
30 shown in Fig. 7. In tiie case of a "normal" tape type, on the other hand, nothing is displayed on tiie endless recording 
display field 307A. 

On an input source display field 307B, a message indicating a selected recording object is displayed. To be more 
specific, if an input from the AV terminal unit 84 on the rear surface of tiie main unit 31 or an input from tiie AV terminal 
unit 43 on tiie front surface of the main unrt 31 is selected, the words "Video 1 " or "Video 2" respectively are displayed 
35 on the input source display field 3078. If the output of the TV tuner 21 3A is selected, a message "TV-O" is displayed on 
the input source display field 3078. It should be noted that, on tiie O mark portion of tiie message, tiie number of a 
channel selected by the TV tuner 21 3A is displayed. On tiie window shown in Fig. 7, a message "TV-r is displayed on 
the input source display field 3078 to indicate that a program broadcasted tiirough Channel 1 is selected as a recording 
object. 

40 The stop button 308, tiie recording button 309 or the pause button 310 Is operated to stop a recording operation, 
to start a recording operation or to temporarily stop a recording operation respectively. It shoukl be noted that when a 
recording operation has been halted temporarily by operating (or clicking) the pause button 310. tiie recording operation 
can be resumed by operating the pause button 310 once more. 

As described above, tiie recording time display change button 31 1 is operated to change a message displayed on 

45 the recording time display fieki 305. To be more specific, each time tiie recording time display change button 31 1 Is 
operated, the message displayed on the recording time display f ieki 305 is switched alternately from a time lapse to a 
remaining period of time and vice versa. 

An input switch button (input button) 312 is operated to change an input selected as a recording object. To be more 
specific, each time the input switch button 312 is operated, one of an input from the AV terminal unit 84 on tiie rear sur- 

50 face of the main unit 31 , an input from the AV terminal unit 43 on tiie front surface of the main unit 31 and the output of 
the TV tuner 213A is selected on tiie so-called rotation basis. When the input switch txitton 312 is operated, a message 
displayed on the input source display field 3078 is also change accordingly. 

With tiie output of the TV tuner 21 3A selected as an input to a recording operation, for example, one of two up and 
down buttons 313 is operated to change the number of a channel selected by the TV tuner 213A from a channel cur- 

55 rently selected to respectively a succeeding or preceding channel shown on channel buttons 314. Witii tiie output of tiie 
TV tuner 21 3A selected as an input to a recording operation, one of the channel buttons 314 is operated to choose a 
channel to be selected by tiie TV tuner 213A. It shouW be noted tiiat, tiie numbers of the channels displayed by the 
channel buttons 314 can be set at any values in the range 1 to 62 by using a "channel setting" item of an optional menu 
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on the slip recorder main window 301. 

With the slip recorder main window 301 having the above configuration displayed, assume that the input switch but- 
ton 31 2 is operated to select an input to a recording operation and, if the output of the TV tuner 213A is selected as the 
input, the up or down button 313 or the one of the channel buttons 314 is operated to select a channel of the input. 

5 Then, the recording button 309 is operated to start the operation to record pictures along with their accompanying 
sound of the selected input. If the recording operation is carried out by the slip recorder, it is necessary to set a tape to 
be used in the recording operation. 

To put it in detail, when a recording operation is requested by operating the recording button 309 and the others as 
desaibed above, pictures of the recording object are encoded by the MPEG1 real time encoder board 21 3 and encoded 

10 data obtained as a result of the encoding operation is stored in the hard disc 212. If the encoded data is sirrply stored 
in the hard disc 212. however, a free area in the hard disc may be insufficient, making it impossible to can-y out the 
recording operation. 

By the way, if the recording operation is carried out to record data on a video tape by means off an apparatus such 
as a VTR. for example, the data can be recorded in a space between the beginning and the end of the video tape with- 
15 out any restriction. This is because the video tape is considered to have a recording capacity allocated in advance. 

With the "Slipclip" facility, a recording area larger than a recording capacity required for carrying out a normal 
recording operation is allocated in the hard disc 212 and data including encoded code is then recorded in the recording 
area. The recording capacity is a minimum recording size required for carrying out a recording operation without abort- 
ing the operation in the course of recording due a free area in the hard disc 212 running out. For the sake off conven- 
20 ience. the recording capacity and the recording area required for recording are referred to hereafter as a required 
capacity and a required area respectively. 

To put it in detail, in an operation to record pictures carried out in this embodiment, a large file required for recording 
an MPEG system stream obtained as a result of MPEG encoding performed by the MPEG1 real time encoder board 
213 and a large file required for recording information such as indexes to be described later are generated. The former 
25 and the latter files are referred to hereafter as an MPEG file and an index file respectively for the sake of convenience. 
Since the files are stored in the hard disc 212. it is necessary to allocate an area required for recording data including 
encoded code, that is, the MPEG system stream, in the hard disc 212 in advance. 

After all. the MPEG arxJ index files with a total size equal to or greater than the required capacity are allocated in a 
free area in the hard disc 212. 

30 The contents of the MPEG and index files right after allocation in the hard disc 21 2 are information with no meaning 
in particular. The allocation of the files corresponds to preparation off a new video tape in a recording operation by 
means of a VTR. For this reason, the files are refen-ed to as a tape in slip recorder. 

A tape can be set by using typically a tape setting dialog box 321 like one shown in Fig. 8. 
The tape setting dialog box 321 is displayed by clicking a message "Standard tape setting", an item of an "Edit- 
as menu displayed on the upper part off the slip recorder main window 301 shown in Fig. 7. 

The user enters a name to be appended to a tape into a name f ieW 322 on the tape setting dialog box 321 . In the 
embodiment shown in Fig. 8. the name "Tape" is entered. A name entered in the name field 322 is a file name common 
to the MPEG and index files constituting a tape being set. It should be noted that, in order to distinguish the MPEG and 
index files from each other, typical file name extensions "MPG" and "SCX" are given to the MPEG and index files 
40 respectively. Thus, with the name "Tape" entered in the name field 322 as a file name, the full file names of the MPEG 
and index files constituting the tape are as a rule TapaMPG" and Tape.SCX" respectively. 

A write protect box 323 is checked to put write protection on the tape. A type f iekJ 324 is used for setting a type of 
the tape described below. 

in the case of the slip recorder. 2 types of a tape, namely, "normal" and "endless", are provided to indicate a normal 
45 tape and an endless tape which are shown in Figs. 9A and 9B respectively. 

When a normal tape is specified, MPEG and index files are created to form a tape with a minimum required record- 
Ing capacity at least equal to a recording time set in a recording time field 325 described later. If a recording time of 1 
hour is set in the recording time field 325, for example, a tape with a recording capacity of 1 hour shown in Fig. 9A is 
created. 

50 When an endless tape is specified, on the other hand, tapes each with a fixed recording capacity of typically 15 
minutes are created to form the erxlless tape like one shown in Fig. 9B. Such tapes are each referred to hereafter as a 
fixed tape for the sake of convenience. As many fixed tapes as required to form an endless tape with a recording capac- 
ity at least equal to a value corresponding to a recording time set in the recording time field 325 are created. That is to 
say, the number of fixed tapes each having a recording capacity of 15 minutes is obtained by dividing the recording time 

55 set in the recording time field 325 by 1 5 minutes and then adding 1 to a quotient obtained as a result of the division. In 
this embodiment, the recording time of each fixed tape is set at a typical value of 15 minutes as will be described later. 
To put it concretely, assume that a recording time of 1 hour is set in the recording time field 325 for example. In this case. 
5 fixed tapes are created to from an endless tape as shown in Fig. 98. Since the number 5 is obtained by dividing 1 hour 
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by 1 5 minutes to give a quotient of 4 and adding 1 to tlie quotient, the endless tape whicli is composed of 5 fixed tapes 

can be used for recording data for a period of up to 1 hour and 1 5 minutes. 

As described above, a normal tape comprises 1 MPEG file and 1 index file, tt is obvious from the embodiment given 

above, however, that an endless tape may comprise a plurality of fixed tapes which each comprise an MPEG file and 
5 an index file. In order to distinguish MPEG files and index files of an endless tape from each other, the name of each 

MPEG file or each index file includes the symbol followed by the sequence number of the file. 

Consider the endless tape shown in Fig. 9B as an example. The endless tape comprises 5 MPEG files and 5 index 

files. Their file names are Tape#1.MPQ, Tape#1.SCX. Tape#2.MPG, Tape#2.SCX. Tape#3.MPa Tape#3.SCX, 

Tape#4.MPG. Tape#4.SCX, Tape#5.MPG and Tape#5.SCX. 
10 An operation to record data on a normal tape is begun at the start of the tape and, at a point of time the end of the 

tape is reached, the operation is terminated. It should be noted that, if an instruction to halt the operation is issued 

before the end of the tape is reached, the operation is terminated at a point of time the instruction is issued. In this case, 

portions of the MPEG and index files that have not been used in the recording operation are freed. That is to say, they 

are released as free areas. 

15 On the other hand, an operation to record data on an endless tape is begun at the start of the first fixed tape if the 
endless tape comprises a plurality of fixed tapes. As the end of the first fixed tape is reached, the operation to record 
data on the first fixed tape is terminated and an operation to record data on the second fixed tape is begun. Thereafter, 
operations to record data on the third, fourth, — , last fixed tapes are candied out sequentially one tape after another. As 
the end of the last fixed tape is reached, an operation to record, strictly speaking, to ovenvrite, data on tiie first fixed 

20 tape is carried out again. 

That is to say, in the enrtxxiiment shown in Fig. 9B, when the operation to record data on all the first to fifth fixed 
tapes is finished, an operation to record, strictly speaking, to ovenvrite, data on the first fixed tape is started. The record- 
ing operation is carried out on a rotation basis till an instruction to end the operation Is issued typically when tiie stop 
button 308 is operated. Such a recording operation on a rotation basis is continued, so to speak, endlessly. 

25 Then, as an instruction to end tiie recording operation is issued, tiie operation is terminated right away at tiiat point 
of time. In this case, in ''Slipdip", a retroactive area with a length specified in the recording time field 325 in the endless 
tape starting from tiie point of time the recording operation is terminated is made a playback range. 

To put it concretely, consider the endless tape shown in Fig. 9B for example. Assume tiiat an instruction to end tiie 
recording operation is issued at a point of time 10-minute recording on the fifth fixed tape is erxded. A hatched area of 

30 1 hour in lengtii shown in the figure which starts at a 1 0-minute position on the first fixed tape and ends at a 1 0-minute 
position on tiie f iftii fixed tape is made a playback range. 

It should be noted that, in this case, an area on the first fixed tape from tiie start thereof to the 10-minute position 
and an area on the f iftii fixed tape from the 10-minute position to tiie end thereof are not playback ranges. Thus, when 
viewed from the standpoint of the utilization efficiency of the hard disc 212, tiiese areas should be both freed. In this 

35 case, however, only tiie area on tiie fifth fixed tape from the 10-minute position to tiie end tiiereof is freed while tiie area 
on the first fixed tape from the start tiiereof to the 10-mlnute position is not for the following reason. 

At the head of an MPEG file of a fixed tape, a system header and information required in an operation to decode 
data experiencing MPEG encoding are recorded. If such an area is discarded, the decoding operation will be difficult to 
carry out. 

40 Thus, data recorded in tiie area on the first fixed tape from tiie start thereof to the 1 0-minute position can be played 
back by directiy accessing tiie MPEG file of the first fixed tape. 

tt should be noted tiiat an endless tape may comprise only 1 fixed tape as is tiie case witii a normal tape instead 
of a plurality of fixed tapes described above. When such an endless tape is created, tiie endless tape is specified as a 
type of the tape. In this case, tiiere can be considered a recording technique whereby a recording operation is started 

45 at tiie beginning of the fixed tape and, as the end thereof is reached, the operation to record, strictly speaking, to over- 
write, data is repeated from tiie same beginning of tiie fixed tape. As described above, however, information including 
a system header is recorded at the head of an MPEG file of a fixed tape. Thus, if such information is ovenAn-itten. the 
decoding operation will be difficult to carry out. tt Is tiierefor desirable to create an endless tape from a plurality of fixed 
tapes. 

50 Refer back to Fig. 8. The user enters a recording time, tiiat is, a period of time required for recording, to tiie record- 
ing time field 325. A recording time up to 1 2 hours witii a resolution of 1 5 minutes can be typically entered to tiiis field. 
It should be noted tiiat a recording time is entered in terms of hours and minutes. 

An automatic index check box 326 is checked to request that an index serving as a mark for representing a position 
of a scene change of a picture be automatically appended in a recording operation. If the automatic index check box 
55 326 is not checked, information such as a scene change pointer arxi a scene change parameter to be described later 
is not recorded in an index file. 

In a video recording mode field 327, a video recording mode indicating bit rate information is set. 4 video recording 
modes are provided to represent 4 bit rates, namely, enumerated in a decreasing order. "High". "Normal", "Long" and 
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"Network". 

Fig. 10 is a table siTowing the size of a frame, a system bit rate, a video bit rate, a frame rate, an audio bit rate, an 
audio recording mode that can be set and a video recording time of a 1 -GB tape for each of the video recording modes. 
The size of a frame is the number of pixels in the horizontal direction X the number of pixels in the vertical direction. The 
system bit rate is the bit rate of a system stream obtained as a result of MPEG encoding of a picture. The video bit rate 
is the bit rate of code obtained as a result of MPEG encoding. The frame rate is the number of frames per second. The 
audio bit rate is the bit rate of a system stream obtained as a result of MPEG encoding of sound. The video recording 
time of a 1 -GB tape is a period of time during which data can be recorded on a tape with a storage capacity of 1 GB. 

As shown in the table, even though the video recording time of a 1-GB tape for the "High" video recording mode is 
shortest, a decoded picture with the highest picture quality can be obtained. In the "Normal" video recording nrnxle. a 
system stream conforming to video CD (VCD) specifications can be obtained as described above. The "Long" video 
recording mode is suitable for an application with a relatively long recording time but requiring a not so high picture qual- 
ity of decoded pictures. The bit rates for the "Network" video recording nrKxie are set at values allowing real time trans- 
mission through an ISDN (Integrated Service Digital Networl^. Thus, the "Network" video recording mode is suitable for 
an application involving such transmission. 

It should be noted that, in the "Long" video recording rrKxIe. tiie number of pixels composing a frame is about 1/4 
of those of the "High" and "Normal" video recording modes. The number of pixels for the "Network" video recording 
mode is even smaller. The frame rate, that is. tiie number of frames per second, is 30 for tiie "High" and "Normal" and 
"Long" video recording modes and 10. 1/3 of 30, for tiie "Network" video recording mode. 

Refer back to Fig. 8. In an audio recording mode field 328. an audio recording mode is set. 3 audio recording 
modes, namely, 2 channels (dual), stereo and nfx>nophonic (single) are provided. 

It should be noted that, in the "High" and "Long" video recording modes, either tiie 2-channel audio recording mode 
or tiie stereo audio recording mode can be selected as shown in tiie table of Fig. 10. In tiie "Normal" video recording, 
however, tiie audio recording nrxxje is fixed at tiie 2-channel mode and. in the "Network" video recording, however, tiie 
audio recording mode is fixed at the nrx)nophonlc mode. 

An auto check box 329 of a clip creation folder is checked to request that a fokJer set in advance to be used as a 
folder for creating a clip. A clip is a pair of MPEG and index files. In tiie slip recorder, such a pair is refenred to as a tape. 
In the clip editor and the dip viewer, however, the pair is called a clip. Thus, a normal tape is considered to be tiie same 
as a clip. Conrposed of a plurality of pairs of MPEG and index files, however, an endless tape corresponds to a plurality 
of clips. 

A reference button 330 of tiie clip creation folder is operated to specify a folder for creating a clip. 

On an infomnation field 331 , information including a size, a frame rate, a video bit rate and an audio bit rate of a 
decoded picture obtained as a result of encoding in a video recording mode set in tiie video recording node field 327 is 
displayed. That is to say, the information such as size shown in the table of Rg. 10 for the specified video recording 
mode is displayed on tiie information field 331 . 

Also displayed on the information field 331 is a size or a recording capacity of a tape allocated on the hard disc 212. 
that is, a size of a disc area allocated to the tape for recording an MPEG system stream obtained as a result of an 
encoding operation in a video recording mode set in the video recording mode field 327 for a recording time set in tiie 
recording time fieki 325. 

The size of the tape is typically calculated as follows. 

The system bit rate for a video recording mode set in tiie video recording mode field 327 is multiplied by a recording 
time set in the recording time fiekJ 325 to find the size of tiie MPEG file of tiie tape. The size of the index file of the tape 
is estimated to be typically 0. 1% of the size of tiie MPEG file. Finally, the size of the tape is found by adding tiie size of 
the index file to tiie size of tiie MPEG file. 

It should be noted tiiat. basically, system bit rates for the video recording modes have tiie values shown in the table 
of Fig. 10. For the "Normal" video recording nrxxle, however, a value smaller than a system bit rate of 1,411.200 bps 
shown in the table of Fig. 1 0 is used for a reason described as follows. The system bit rate shown in tiie table of Fig. 1 0 
for the "Normal" video recording mode is a value applicable to an operation to record an MPEG system stream onto a 
video CD. This value represents the bit rate of a bit stream obtained by adding information such as a sink and a header 
prescribed in video CD specifications to a pack of tiie MPEG system stream. That is to say. the system bit rate shown 
in the table of Fig. 10 is a bit rate conforming to tiie video CD specifications. In an operation to record an MPEG system 
stream onto tiie hard disc 212. such information including a sink and a header is not required. In addition, when viewed 
from tiie standpoint of tiie utilization efficiency of the hard disc 212, unnecessary data should not be recorded in the 
hard disc 212. 

Thus, for tiie "Norniar vkJeo recording mode, the size of a tape is calculated by assuming that tiie bit rate of tiie 
MPEG system stream composing of only a pack is 1 ,394,400 bps. 

To put it concretely, consider the embodiment shown in Fig. 8 in which tiie "Normal" video recording nrxxie is 
selected and a recording time of 1 hour is set. If a normal tape is specified as a tape type, the size of the tape will be 
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computed by multiplying the system bit rate 1 ,394.400 bps by the recording time 1 hour and adding 0. 1 % of the product 
obtained as a result of the multiplication to the product. In the embodiment shown in Rg. 8, however, an erxiless tape 
is specified as a tape type. According to what has been described before, the recording capacity of the endless tape is 
longer than the recording time 1 hour specified in the recording time field 325 by a difference of 15 minutes. An endless 

5 tape size of 748.76 MB is found by multiplying the system bit rate 1 ,394.400 bps by the recording time (1 hour + 15 min- 
utes) and adding 0.1% of the product obtained as a result of the multiplication to the product. The size 748.76 MB of 
the endless tape is displayed on the information field 331 of the tape setting dialog box 321 shown in Fig. 8. 

An OK button 332 is operated to confirm items set anew in the tape setting dialog box 321 and close the dialog box 
321 . A cancel button 333 is operated to keep items set previously in the tape setting dialog box 321 and close the dialog 

10 box 321 . A help button 334 is operated to display explanations for helping the user understand the tape setting dialog 
box 321. 

Next, the recording process carried out by means of the slip recorder is explained by refenring to flowcharts shown 
in Figs. 11 and 12. 

In order to carry out a recording operation, first of all, the user opens the tape setting dialog box 321 shown in Rg. 
15 8 for setting a tape as described earlier. 

Then, assume that a television broadcast program is recorded as an example. In this case, the input switch button 
312 of the slip recorder main window 301 shown in Fig. 7 is operated to select the output of the TV tuner 213A shown 
in Fig. 5 as an input to the recording process. Then, one of the up and down txjttons 313 or one of the channel buttons 
31 4 is operated to select the channel of the program to be recorded. 
20 When recording or dubbing pictures and the accompanying sound which have been recorded by means of the 
video camera 21 4. video and audio output terminals of the video camera 21 4 not shown in the figures are connected to 
the AV terminal unit 84 on the rear surface of the main unit 31 or the AV terminal unit 43 on the front surface thereof. 
Then, the input switch button 31 2 Is operated to select the AV terminal unit 84 or 43 as an input to the recording process. 
When the user operates the recording button 309 of the slip recorder main window 301 after the setting operations 
25 described above, the microprocessor 201 carries out a recording process in accordance with the flowchart shown in 
Fig. 11 or 12. 

The flowchart shown in Fig. 1 1 represents a recording process wherein a normal tape has been set as a tape used 
in the recording process. As shown in the figure, the flowchart begins with a step SI to form a judgment as to whether 
a tape can be created or not. 

30 An area in the hard disc 212 required for a recording process is not allocated to a specified tape by merely setting 
the tape through the tape setting dialog box 321 . That is to say, it is not until the recording button 309 is operated that 
a tape is allocated in the hard disc 212. This is because, when viewed from the standpoint of utilization efficiency of the 
hard disc 212. allocation of a tape prior to the start of a recording process is not desirable. 

In the formation of the judgment at the step SI , the size of the specified tape is computed in the way described ear- 

35 Her. The judgment is then based on confirmation as to whether an area with the computed size can be allocated in the 
hard disc 212. 

If the outcome of the judgment formed at the step SI indicates that the specified tape can not be made, that is. if 
the outcome indicates that a free area with a size at least equal to the computed tape size in the hard disc 212 can not 
be allocated to the specified tape, typically a message irxiicating this problem is displayed and the recording process is 

40 terminated. In this case, no recording is carried out. 

If the outcome of the judgment formed at the step SI indicates that the specified tape can be made, that is, if the 
outcome indicates that an MPEG file and an index file of the specified tape can be stored in the hard disc 212, on the 
other hand, the flow of the process goes on to a step S2 at which the MPEG and index files are allocated in the hard 
disc 212. It should be noted that, at the present stage, the MPEG and irxiex files contain no meaningful information in 

45 particular as described before. That is to say, a free area in the hard disc 212 is merely allocated to the MPEG and index 
files. 

Then, the flow of the process proceeds to a step S3 at which the MPEG file of the tape is opened. The flow of the 
process then continues to a step 84 at which the MPEG1 real time encoder board 213 is controlled to carry out MPEG 
processing therein on an input selected by operating the input switch button 312. 
50 Subsequently, the flow of the process goes on to a step S5 at which an MPEG system stream obtained as a result 
of the MPEG encoding is transferred to the hard disc 212 to be written into the MPEG file allocated therein at the step 
S2. Then, the flow of the process proceeds to a step S6 to form a judgment as to whether or not the MPEG system 
stream being written has reached the end of the MPEG file and whether or not the stop button 308 has been operated 
to request that the recording process be terminated. If the outcome of the judgment indicates that the MPEG system 
55 stream being written has not reached the end of the MPEG file and the stop button 308 has not been operated, the flow 
of the process returns to the step S4 to continue the encoding and the recording of object pictures. 

If the outcome of the judgment indicates that the MPEG system stream being written has reached the end of the 
MPEG file or the stop button 308 has been operated, on the other hand, the flow of the process goes on to a step S7 
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at which the MPEG file is closed to end the recording process. 

The following is a description of a recording process wherein an endless tape has been set as a tape used in the 
recording process carried out in accordance with the flowchart of Fig. 12. 

As shown in the figure, the flowchart begins with a step S1 1 to be followed by a step S12 which are basically the 

5 same as the steps S1 and S2 of the flowchart shown in Fig. 1 1 respectively. It should be noted, however, that at the step 
SI 2. an erxJIess tape comprising a plurality of fixed tapes like the one shown in Fig. 9B described before is created. 

After completing the processing of the step S12, the flow of the process goes on to a step S13 at which the MPEQ 
file of a head fixed tape, that is, the first fixed tape, of the endless tape is opened. The flow of the process then proceeds 
to a step S14 at which the MPEG1 real time encoder board 213 is controlled to carry out MPEG processing therein on 

10 an input selected by operating the input switch button 31 2. 

Subsequently, the flow of the process goes on to a step SI 5 at which an MPEG system stream obtained as a result 
of the MPEG encoding is transferred to the hard disc 21 2 to be written into the MPEG file. Then, the flow of the process 
proceeds to a step SI 6 Id form a judgment as to whether or not a request has been made to terminate the recording 
process typically by operating the stop button 308. If the outcome of the judgment formed at the step SI 6 indicates that 

15 a request has not been made to terminate the recording process, the flow of the process continues to a step SI 7 to 
form a judgment as to whether or not the MPEG system stream being written has reached the end of the MPEG file of 
the fixed tape. If the outcome of the judgment formed at the step SI 7 indicates that the MPEG system stream being 
written has not reached the end of the MPEG file of the fixed tape, the flow of the process returns to the step SI 4 to 
continue the encoding and the recording of object pictures. 

20 If the outcome of the judgment formed at the step SI 7 indicates that the MPEG system stream being written has 
reached the end of the MPEG file of the fixed tape, on the other hand, the flow of the process goes on to a step SI 8 at 
which this MPEG file is closed. Then, the flow of the process proceeds to a step SI 9 at which the MPEG file of the next 
fixed tape is opened. The flow then returns to the step S14. As a result, the MPEG system stream is recorded on the 
MPEG file of the next fixed tape. 

25 As the MPEG system stream being written has reached the end of the MPEG file of the last fixed tape, at the step 
SI 9. the MPEG file of the first fixed tape is opened again. The MPEG system stream is then recorded on the first fixed 
tape, ovenwriting data recorded thereon previously. As a result, the MPEG system stream is recorded endlessly so to 
speak till the outcome of the judgment formed at the step SI 6 indicates that a request has been made to terminate the 
recording process. 

30 When the stop button 308 is operated, for example, the outcome of the judgment formed at the step SI 6 indicates 
that a request has been made to terminate the recording process. In this case, the flow of the process goes on to a step 
S20 at which the opened MPEG file is closed to terminate the recording process. 

In the recording process, an MPEG system stream is recorded on the MPEG file of a tape as described above and, 
at the same time, predetermined data is stored in the index file of the same tape. 
35 Fig. 1 3 shows a flowchart representing an index recording process to record data in an index file. 

As shown in the figure, the flowchart begins with a step S30 at which an index file is opened and a header Is 
recorded in the index file. The header includes, among other information, a start time and a recording mode set on the 
tape setting diabg box 321 shown in Fig. 8. The start time is a time, strictly speaking, the present time, at which record- 
ing is started. The flow of the process then goes on to a step S31 at which the microprocessor 201 forms a judgment 
40 as to whether or not index data has been transmitted by the scene change detecting circuit 1 31 employed in the MPEG1 
real time encoder board 213 shown in Fig. 6. If index data has not been received, the fbw of the processing goes on to 
a step S39. skipping steps S32 to S38. 

If the outcome of the judgment formed at the step S31 indicates that index data has been transmitted by the scene 
change detecting circuit 131 shown in Fig. 6, on the other hand, the miaoprocessor 201 receives the index data. The 
45 flow of the process then proceeds to the step S32. 

Fig. 14 is a diagram showing a typical format of index data transmitted by the scene change detecting circuit 131 . 
As shown in the figure, the index data comprises a 4-bit area for storing a variety of flags followed by a 28-bit area 
for storing the secorxj parameter SAD computed by using Eq. (4) as described earlier to give a total length of 32 bits. 
The 4-bit area typically includes a picture type flag and a scene change flag. The picture type flag indicates a picture 
50 type of a frame subjected to computation of the second parameter SAD and the scene change flag indicates whether 
or not the scene change detecting circuit 131 has detected a scene change. 

Refer back to Fig. 13. At the step S32, the microprocessor 201 examines the index data received from the scene 
change detecting circuit 131 in order to form a judgment as to whether the index data indicates an I or P picture. It 
should be noted that the judgment is formed typically by referring to the picture type flag included in the index data. 
55 If the outcome of the judgment formed at the step S32 shows that the index data indicates that the picture type is 
neither an I picture nor a P picture, that is. if the picture type is the B picture, the flow of the processing goes on to the 
step S39, skipping the steps S33 to S38. If the outcome of the judgment formed at the step S32 shows that the index 
data indicates an I picture or a P picture, on the other hand, the flow of the process proceeds to the step S33 at which 
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the microprocessor 201 forms a judgment as to whether or not a scene change in the I or P picture has been detected. 

It should be noted that the judgment is formed typically by referring to the scene change flag included in the index data. 
If the outcome of the judgment formed at the step S33 indicates that a scene change has not been detected, the 

flow of the processing goes on to the step S38, skipping the steps S34 to S37. If the outcome of the judgment formed 
5 at the step S33 indicates that a scene change has been detected, on the other hand, the flow of the processing goes 

on to the step S34 at which the microprocessor 201 computes a scene change parameter. To be more specific, the 

microprocessor 201 divides an SAD included in the index data received this time by a previous SAD saved at the step 

S38 to be desaibed later, using a result of the division as a scene change parameter. 

The scene change parameter indicates the magnitude of a scene change, that is, a degree to which a screen 
10 changes. TTie larger the magnitude, the greater the value of the scene change parameter. It should be noted that the 

scene change parameter is not limited to the quantity obtained by the division described above. The scene change 

parameter can be any quantity of physics as long as the quantity indicates the magnitude or the degree of a scene 

change. 

After the scene change parameter is connputed, the flow of the process continues to the step 835 at which the 
IS microprocessor 201 forms a judgment as to whether or not the scene change parameter Is greater than a predeter- 
mined threshold value e of typically 3. If the outcome of the judgment formed at the step S35 indicates that the scene 
change parameter is not greater than the predetermined threshold value e, the flow of the processing goes on to the 
step S38, skipping the steps S36 and 837. 

If the outcome of the judgment formed at the step S35 indicates that the scene change parameter is greater than 
20 the predetermined threshold value e. on the other hand, the flow of the processing goes on to the step 836 at which a 
scene change pointer is found and associated with the scene change parameter. A scene change pointer is information 
on a location in the MPEG file for storing encoded data of a frame whose scene change is represented by the scene 
change parameter. Then, an identification flag to be described later is added to the scene change pointer and the scene 
change parameter. Finally, the identification flag, the scene change pointer and the scene change parameter are stored 
25 in the index file. 

It should be noted that a scene change pointer is typically an offset of a specific location expressed in terms of 
bytes from the head of an MPEG file for storing encoded data at the specific location. 

For the sake of convenience, information comprising a scene change pointer, a scene change parameter and an 
identification flag added thereto is referred to as an index. An index plays the role of a mark indicating the position of a 
30 scene Change. 

It should be noted that, an index appended by the microprocessor 201 and stored in the index file in a recording 
operation is refon^ed to as an automatic index. An index can also be appended by a predetermined operation candied 
out by the user. An index appended by an operation carried out by the user is referred to as a manual index. The kien- 
tif ication flag is typically 1 -bit flag for distinguishing an automatic index from a nrranual index. 

35 After the processing of the step 836, the flow of the process goes on to the step 837 at which a scene change indi- 
cator 303 is displayed on the slip recorder main window 301 shown in Rg. 7 for a predetermined period of time in order 
to inform the user that a scene change has occun^ed. The flow of the process then proceeds to the step 838 at which 
the SAD included in the index data received this time is stored in the main memory unit 202 to replace the SAD stored 
previously. Then, the flow of the process continues to the step 839 to form a judgment as to whether or not the operation 

40 to record the MPEG system stream into the MPEG file has been finished. If tiie operation to record the MPEG system 
stream into tiie MPEG file has not been finished, tiie f fow of the process returns to tiie step 831 to repeat tiie operations 
described above. 

If tiie outcome of the judgment formed at tiie step 839 Indicates tiiat operation to record tiie MPEG system stream 
into tiie MPEG file has been finished, on tiie otiier hand, the index file is closed to terminate the index recording proc- 
45 ess. 

In tiie embodiment represented by tiie ffowchart shown in Fig. 13, only if the scene change flag indicates that a 
scene change has been detected by the scene change detecting circuit 131 and the scene change parameter is greater 
than the predetermined tiireshokl value e is an index recorded. It should be noted tiiat an index may also be recorded 
witiiout regard to tiie magnitude of the scene change parameter. In this case, however, an index is appended also to a 
50 frame witiiout such a large scene change, increasing the number of indexes as a result. 

If any arbitrary scene of an already recorded picture can be played back in tiie course of recording of pictures and 
their accompanying sound, more convenience can be reaped from the personal computer. When tiie user looks at 
sometiiing else in the course of recording of pictures and their acconpanying sound, overlooking a scene, for example, 
more convenience can be reaped from tiie personal computer if tiie user is allowed to retroactively play back recorded 
55 pictures including the overlooked one. 

in order to provide such convenience, the slip recorder is designed to include a function that allows any arbitrary 
scene of an already recorded picture to be played back in the course of recording of pictures and tiieir acconnpanying 
sound while tiie recording is being carried out, that is. without tiie need to suspend tiie recording operation. Such a play- 
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back operation is referred to hereafter as a slip playback operation for the sake off convenience. 

In order to carry out a slip playback operation, the user selects a "Slip" item from a 'Playback* menu at the upper 
portion of the slip recorder main window 301 shown in Fig. 7. When the "Slip" item is selected, typically, a playback win- 
dow 341 like one shown in Rg. 15 is displayed. 

5 On a picture display area 342 of the playback window 341 . a played back picture is displayed. On the playback indi- 

cator 343. the current playback status is displayed. To be more specific, for example, a message TLAY" indicating that 
the playback operation is undenway. "PAUSE" indicating that the playback operation is temporarily suspended. "STOP" 
indicating that the playback operation is halted. "SLOW" indicating that a slow playback operation is under way. "F. 
SKIP" indicating that a skip operation in the fonward direction is under way or "R. SKIP" indicating that a skip operation 

10 in the backward direction is under way is displayed on the playback indicator fieki 343. 

On a playback time display field 344. oneof the following 3 pieces of information is displayed as shown in Fig. 16: 

a lapsing period of time since a point of time recording is started (referred to hereafter as a start point of time for 
the sake of convenience) to a position subjected to a slip playback operation (referred to hereafter as a playback 
15 point for the sake of convenience); 

a remaining period of time from the playback point to a position subjected to recording (referred to hereafter as a 
recording point for the sake of convenience); or 

a point of time at which a picture, that is. encoded data, at the playback point was recorded (referred to hereafter 
as a recording point of time for the sake of convenience). 

20 

It should be noted that, in the case of an already recorded tape, the remaining period of time is a period from the 
playback point to the end of the tape. One of the 3 pieces of information to be displayed is selected by operating a play- 
back time display change button 353. 

In a slip playback operation, the relative positional relation between the playback and recording points does not 
25 change as long as the playback point is not shifted by a slider 354 to be described later. Thus, in a slip playback oper- 
ation, if a remaining period of time is selected, time information displayed on the playback time display field 344 remains 
fixed or all but fixed because the remaining period off time is a period corresponding to a distance from a playback point 
to a recording point. 

It should be noted that the playback window 341 is opened not only when a slip playback operation is requested. 
30 but also when a request is made to monitor an input selected by the input switch button 312 of the slip recorder main 
window 301 or a request is nrrade to play back a tape which has completed a recording operation. When the playback 
window 341 is opened for monitoring a selected input. "- : - : -" is displayed on the playback time display fiekl 344. 
When the playtsack window 341 is opened for playing back a tape which has completed a recording operation and a 
remaining period of time is selected as time information to be displayed on the playback time display field 344, a period 
35 from a playback point to the end of the tape is displayed. 

On an audio output mode display f ieU 345. the current audio output mode is displayed. Typically, there are provided 
3 audio output nrxxles, namely, a stereo audio output nnode, a nrxxle to output sound from the right and left speakers of 
the L channel only and a mode to output sound from the right and left speakers off the R channel only. One of the 3 audio 
output nKxies is selected by operating an audio output switch button 357. It should be noted that, when the stereo audio 
40 output mode, the nrKxie to output sound from the right and left speakers off the L channel only or the mode to output 
sourKi from the right and left speakers of the R channel only is selected, on the audio output mode display f iekl 345. a 
message "STEREO", "L ONLY" or "R ONLY" is respectively displayed 

A stop button 346, a playback button 347 or a pause button 348 is operated to respectively halt, start or temporarily 
suspend the playback operation. A skip button 349 or 350 is operated to skip a portion of the tape in the backward or 
45 fbnvard direction respectively. An index button 351 or 352 is operated to skip a portion of the tape to a frame with an 
index appended thereto that is closest to a playback point in the backward or fbnward direction respectively. 

The playt)ack time display change button 353 is operated to select time information to be displayed on the ptayt^ack 
time display field 344. It should be noted that, each time the playback time display change button 353 is operated, the 
time information is changed on a rotation basis for example as follows: a lapsing period of time -> a remaining period 
50 of time -> a recording point of time -> a lapsing period of time — and so on. 

The slider 354 is used to change the playback point. To put it in detail, the slider 354 can be shifted typically by drag- 
ging it using the mouse 22. At that time, the playback point is changed to a position corresponding to a location of the 
slider 354. It should be noted that the slider 354 can be shifted horizontally along a groove provided for the motion of 
slider 354. The left end of the groove of the slider 354 corresponds to a position at which recording is started, that is. 
55 the beginning of an MPEG file. On the other hand, the right end of the groove of the slider 354 con-esponds to a record- 
ing point. Thus, the user is capak}le of playing back any art}itrary screen between a position at which the recording was 
started and a point immediately preceding a screen currently being recorded by operating the slider 354. 

It should be noted, however, that in the MPEQ1 real time encoder board 213. a pre-encoding picture is temporarily 
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stored in the frame memory unit 1 10 arKl code obtained as a residt of the encoding is temporarily stored in the output 
ixiffer 118 as described above. In addition, it takes time to a certain degree to carry out MPEG encoding and to store 
code obtained as a result of the MPEG encoding in the output buffer 1 1 8. Thus, a screen that can be subjected to a slip 
playback operation is a screen preceding a screen currently being recorded by at least a period in the range about 10 
5 secofKls to 1 5 seconds. 

The slider 354 can be shifted by the user as described above. In addition, the slider 354 is also shifted in a playback 
operation along with the motion of the playk>ack pointer. Furthernwre, the slider 354 is shifted when the playback point 
is moved by operating the skip button 349 or 350. or the index button 351 or 352. 

It should be noted that when the slider 354 is shifted to change the playback point, the time information displayed 
10 on the playback time display field 344 is also changed in accordance with a change in playback point position. 

With a playback operation temporarily halted by operating the pause button 348. a frame feed button 355 is oper- 
ated to feed a frame, that is. to display a next frame on the picture display area 342. A slow playback button 356 is oper- 
ated to carry out a slow playback operation. The audio output switch button 357 is operated to select an audio output 
mode. It should be noted that, each time the audio output switch kxjtton 357 is operated, the audio output nKxJe is 
IS changed on a rotation basis for example as follows: the stereo audio output mode -> the mode to output sound from the 
right and left speakers of the L channel only the mode to output sound from the right and left speakers of the R chan- 
nel only the stereo audio output mode — and so on. 

Next, a slip playback process carried out by the slip recorder is explained by referring to a flowchart shown in Rg. 

17. 

20 As shown in the figure, the flowchart begins with a step S40 at which the microprocessor 201 reads out an MPEG 
system stream from the head of an MPEG file of a tape currently subjected to a recording operation when the playback 
window 341 is operated. The flow of the process then goes on to a step S41 at which the microprocessor 201 executes 
an application program stored in the hard disc 212 to decode the MPEG system stream read out at the step S40. The 
application program, which is called an MPEG1 software decoder 201 A shown in Rg. 18. is an application program for 

25 carrying out MPEG decoding as will be described later. Then, the fk)w of the process proceeds to a step S42 at which 
a result of the decoding is output. 

To be more specific, at the step 342. a picture of the decoding result is displayed on the picture display area 342 of 
the playback wirKlow 341 whereas sourxJ of the decoding result is output to the speakers 59 and 60. 

Subsequently, the flow of the process continues to a step S43 at which time information corresponding to a position 

30 in the MPEG system stream read out at the step S40 is displayed on the playback time display f iekl 344 of the playback 
window 341 . The tme information displayed on the playt>ack time display field 344 is one of the aforementioned 3 types 
of information selected by operating the playback time display change txjtton 353. The time information is found by the 
microprocessor 201 as follows. 

As described atxive. since the MPEG system stream has a fixed rate, a lapsing period of time corresporxllng to a 

35 position in the MPEG system stream read out at the step S40 can be found from a recording position in the MPEG sys- 
tem stream, that is, a recording offset from the beginning of the MPEG file expressed in terms of bytes. A remaining 
period of time can be found as a distance expressed in terms of bytes from a position in the MPEG system stream read 
at the step S40 to a position in the MPEG system stream currently being recorded. A recording point of time is found 
by adding the lapsing period of time to a recording start point of time stored at the head of an index file of the tape as 

40 desaibed before. 

Pieces of time information for each position in an MPEG system stream recorded in an MPEG file can be found in 
a way described above. It should be noted that as a typical alternative, a recording point of time for each point in the 
MPEG system stream is stored and the other pieces of time information can be found from the recording point of time. 

After completing the processing of the step S43. the flow of the process goes on to a step S44 at which the miao- 
45 processor 201 forms a judgment as to whether or not the playback point has been changed typically by shifting the 
slider 354 or operating the skip button 349 or 350, or the index button 351 or 352. If the outcome of the judgment formed 
at the step S44 indicates that the playback point has not been changed, the flow of the process returns to the step S40 
at which a continuation to the MPEG system stream read out in the immediately preceding iteration is read out from the 
MPEG file. The pieces of processing of the subsequent steps are then repeated. 
so If the outcome of the judgment formed at the step S44 indicates that the playback point has been changed, on the 
other harxj, the flow of the process goes on to a step S45 to change a position In the MPEG system stream, from which 
code is read out, in accordance with the change in playtmck point. The f Ibw of the process then returns to the step S40 
at which the MPEG system stream is read out from the new position set at the step S45. 

The pieces of processing of the subsequent steps are then repeated. 
55 The slip playback process is terminated typically when the playback window 341 is closed or when the stop button 
346 is operated. 

As described above, during a recording operation, pictures and their accompanying sound already recorded In the 
hard disc 212 can be played back starting from any arbitrary position while the recording operation is being continued. 
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Thus, the user is capable of viewing a desired scene without suspending the recording operation. 

In addition, since time information is displayed on the playback time display field 344 of the playback window 341 , 
by referring to the displayed time information, the user is capable of finding a desired scene in a relatively short period 
of time. 

5 It should be noted that, during a slip playback operation, data is read out and written from and into the hard disc 

21 2 on the so-called time sharing basis. The scheduling of the operations to read out and write data is carried out under 
control of the Windows 95 OS (operating system) without any intervention in particular by the Slipclip application pro- 
gram. It should be noted, nevertheless, that the scheduling can also be controlled by the Slipclip application program 
itself. 

10 To put it in detail, operations to read out and write data from and into a hard disc put to practical use nowadays are 
carried out at a sufficiently high speed, making it basically possible to canry out a slip playback process by merely read- 
ing out and writing data from and into the hard disc under I/O control of the OS without the need to suspend a recording 
operation. 

As described above, a picture reproduced in a slip playback operation is displayed on the picture display area 342 
IS of the playback window 341 as shown in Fig. 15. In addition, such a picture can also be displayed on a so-called full 
screen. That is to say, the picture display area 342 can be enlarged to the whole screen of the display apparatus 51 . 
Next, the processing canried out by the slip recorder is explained more by refen^ing to Fig. 18. 
During a recording operation carried out by the slip recorder, in the MPEG1 real time encoder board 213, a picture 
and its accompanying sound are subjected to MPEG encoding to produce an MPEG system stream which is then 
20 recorded into an MPEG file of a tape created in advance in the hard disc 212. Then, a scene change parameter is com- 
puted from index data output by the MPEG1 real time encoder board 213. The scene change parameter is then stored 
in an index file of the tape created in advance in the hard disc 21 2 along with a scene change pointer and an identifica- 
tion flag. 

As shown in Fig. 18. at the head of the index file, a header (H) including a start time and a recording mode is 

25 recorded. The start time is a point of time at which recording Is started. 

An identification flag, a scene change pointer and a scene change parameter are recorded in the index file when a 
scene change flag included in index data indicates that a scene change has been detected and the scene change 
parameter is greater than the predetermined threshokl value e as shown In Fig. 19. A scene change pointer recorded 
in the index file represents a position in the MPEG file as shown in Rg. 1 8. At that position, encoded data of a frame in 

30 which a scene change occurs is recorded. 

In the slip playt>ack process carried out by the slip recorder, on the other hand, the MPEGl software decoder 201 A, 
an application program for carrying out MPEG decoding, is executed by the microprocessor 201 to read out and decode 
data from any arbitrary position In an area in the MPEG file shown as a long black rectangular in Fig. 18. In the area, 
an MPEG system stream has already been recorded. 

35 During a recording operation, the MPEG file is opened in the so-called shared mode so that the MPEG file can be 
accessed by a plurality of application programs. In the shared mode, the MPEGl real time encoder board 213 is thus 
allowed to write an MPEG system stream into the MPEG file and. at the same time, the MPEGl software decoder 201 A 
is allowed to read out the MPEG system stream as well. 

In the case of an endless tape, since the endless tape comprises a plurality of fixed tapes as described before, an 

40 MPEG system stream specified as code subjected to a slip playback operation may have been recorded in an MPEG 
file of a fixed tape different from an MPEG file of a fixed tape into which an MPEG system stream output by the MPEGl 
real time encoder board 213 is written. In this case, the MPEG file in which an MPEG system stream specified as code 
subjected to a slip playback operation has been recorded is opened separately from the MPEG file Irrto which an MPEG 
system stream output by the MPEG1 real time encoder board 213 is written. When the read operation is finished, the 

45 MPEG file in which an MPEG system stream specified as code subjected to a slip playback operation has been 
recorded is closed. 

As described above, in this embodiment, an MPEG system stream is recorded in an MPEG file while indexes each 
comprising an identification flag, a scene change pointer and a scene change parameter are recorded in an index file 
which is allocated separately from the MPEG file. Thus, data conforming to MPEG specifications can be stored in an 
50 MPEG file and can therefore be used by another application program. 

It shouki be noted that an MPEG system stream and indexes can also be recorded in the same file. In this case, 
however, it will be difficult for other application programs to use the file. 

If an automatic index check box 326 of the tape setting dialog box 321 shown in Fig. 8 is not checked, unlike what 
has been described above, no index is recorded in an index file. That is to say, in this case, an index file comprises only 
55 a header. 

As described above, recording and playback operations can be carried out concurrently. It should be noted that the 
"Normar video recording mode has been assumed and, in order to simplify the desalption, the amount of data of a 
video element stream is computed instead of the amount of data of an MPEG system stream. 
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In the "Normar video recording nrKXje, a picture frame picture comprises 352 pixels X 240 pixels as shown in the 
table of Fig. 10. Assume that each pixel comprises typically an 8-bits Y luminance signal and. if converted into a pixel, 
a 2-blt chrominance signal, namely, a 1 -bit Cb chrominance signal and 1 -bit Cr chrominance signal to give a total of 12 
bits. Also assume that 1 GOP comprises typically 15 frames. In this case, the amount of data of 1 GOP (that is. the 
5 amount of data prior to encoding) is found by using the following equation to be 1 ,856 KB. 

Amount of data s 352 pixels X 240 pixels X 12 bits X 15 frames^S bits - 1 ,856 KB 

In addition, in the "Normal** video recording nrxxfe. the video rate of a video elementary stream in the MPEG1 real 
10 time encoder board 213 is 1 .151 ,929 bps and the frame rate is 30 frames/second as shown in the table of Fig. 10. Thus, 
picture data of 1 GOP which comprises 1 5 frames as described above is compressed into an amount of data expressed 
by the following equation: 

1,151,929/30 frames X 15 frames/8 bit = 70.3 KB 

IS 

Thus, in this case, the picture data is compressed at a compression ratio of 1/26.4 (>■ 70.3 KB/1 ,856 KB). 

By the way. the inventor of the present Invention has found out through measurement that the transfer speed of a 
certain HDD is about 4 MB/second. At this transfer speed, the 70.3KB compressed data of 1 GOP can be stored in the 
HDD in about 17.2 ms 70.3/(4 X 1.024)). 
20 Thus, even if a very long head seek time of the HDD, for example, a head seek time of 20 ms, is assumed, the 
length of time it takes to store compressed data of 1 GOP into the HDD is about 37.2 ms (= 17.2 ms + 20 ms). 

On the other hand, a transfer speed at which data is read out from the HDD is generally higher than the write trans- 
fer speed. Assume that the read transfer speed is the same as the write transfer speed and that the read seek time is 
also the same as the write seek time which is 20 ms as desaibed above. In this case, the length of time it takes to read 
25 out compressed data of 1 GOP from the HDD is also about 37.2 ms. 

Since 1 GOP comprises 1 5 frames, it takes about 0.5 seconds to transfer 1 GOP at the transfer rate 30 frames/sec- 
ond. Since compressed data of 1 GOP can be read out and written in about 74.4 ms (:= 37.2 ms + 37.2 ms). operations 
to record and play back pictures can be canied out concurrently during a transfer period of 1 GOP which is about 0.5 
seconds. 

30 It should be noted that, in the case of the "Long" video recording mode, the amount of data of 1 GOP prior to com- 
pression is 394 KB and reduced to 22.9 KB by encoding. Thus, the data is compressed at a compression ratio of about 
1/17.2. Consider an HDD having the same specifications as the "Normal" video recording mode described above. In 
this case, since the length of time it takes to store or to read out compressed data of 1 GOP into or from the HDD is 
about 25.6 ms. operations to record and play back pictures can also be carried out concurrently during a transfer period 

35 of 1 GOP which is about 0.5 seconds. 

By the way, since Windows 95 is an OS having a multitask functfon, other processing can be carried out while an 
operation to write an MPEG system stream into the hard disc 21 2 is in a wait state. Thus, if the user performs an oper- 
ation requesting that other processing be carried out in the course of a slip playfc)ack, the other processing may be 
implemented even if an operation to write an MPEG system stream into the hard disc 212 is set at the highest priority. 

40 it is thus desirable for the user not to perform an operation requesting that other processing be carried out in the course 
of a slip playt>ack. However, it is difficult to prevent all users without exception from doing such an operation. 

On the other hand, if an operation to write an MPEG system stream into the hard cfisc 212 is in an excessively long 
wait state that can not keep up with the bit rate of the MPEG system stream, the MPEG system stream will be 
destroyed, making it difficult to decode the stream. It is thus necessary to absolutely prevent an MPEG system stream 

45 from being destroyed. 

In case an operation to write an MPEG system stream into the hard disc 212 can not keep up with the bit rate of 
the stream, encoding carried out by the MPEG1 real time encoder board 213 is suspended under control executed by 
the controller 133 shown in Fig. 6. 

Fig. 20 shows a flowchart representing the control executed by the controller 133 which nrtonitors the annount of 

50 data stored in the output buffer 1 18 as described before. As shown in the figure, the flowchart begins with a step S51 
to form a judgment as to whether or not the amount of data stored in the output buffer 1 18 is greater than a predeter- 
mined value of typically 100 KB. If the outoome of the judgment formed at the step S51 indicates that the amount of 
data stored in the output txjffer 1 1 8 Is not greater than the predetermined value, the f fow of the control goes on to a step 
S52 at which the controller 133 controls blocks composing the MPEG1 real time encoder board 213 to carry out MPEG 

55 encoding normally. The flow of the control then returns to the step S51 . The reason why the predetermined value is set 
typically at 100 KB is that the typical storage capacity of the output buffer 1 18 is 160 KB as described before. It means 
that, if there is a margin or a free area of at least 60 KB in the output buffer 1 1 8. the MPEG encoding can-ied out by the 
MPEG1 real time encoder board 213 is continued as it is. 
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If the outcome of the judgment formed at the step S51 indicates that the amount of data stored in the output buffer 
11 8 is greater than the predetermined value 1 00 KB, on the other hand, the flow of the control goes on to a step S53 at 
which the controller 133 suspends or temporarily halts the encoding carried out by the MPEQ1 real time encoder board 
213. To be more specific, the controller 133 typically neither lets more pictures be stored in the frame memory unit 110 

5 nor a picture be read out from the frame memory unit 1 10. As a result, the operation to write the MPEG system stream 
into the hard disc 212 is also discontinued as well. To put it accurately, a device driver of the hard disc 212 does not 
make a request for an MPEG system stream anymore. Thus, if the amount of data stored in the output buffer 118 
exceeds 100 KB, leaving only a free area smaller than 60 KB in the buffer 118, the controller 133 suspends or tempo- 
rarily halts the MPEG encoding carried out by the MPEG1 real time encoder board 213. 

10 The flow of the control then goes on to a step S54 at which the, controller 133 forms a judgment as to whether or 
not the amount of data stored in the output buffer 1 18 is smaller than a predetermined value of typically 50 KB. If the 
outcome of the judgment formed at the step S54 indicates that the amount of data stored in the output buffer 1 1 8 is not 
smaller than the predetermined value, the flow of the control returns to the step 54. If the outcome of the judgment 
formed at the step S54 indicates that the amount of data stored in the output buffer 1 18 is smaller than the predeter- 

15 mined value, that is, if an operation to write an MPEG system stream into the hard disc 212 which has been put in a 
wait state so far is started to extract data from the output buffer 1 1 8, reducing the amount of data stored therein to a 
value smaller than 50 KB. on the other hand, the flow of the control goes on to a step S55 at which the controller 133 
requests the MPEG1 real time encoder board 213 to resume the encoding. To be more specific, the controller 133 typ- 
ically lets wore pictures be stored in the frame memory unit 1 10 and a picture be read out from the frame memory unit 

20 110. Then, the flow of control returns to the step S51 . 

As described above, in case an operation to write an MPEG system stream into the hard disc 2 1 2 can not keep up 
with the bit rate of the stream, encoding carried out by the MPEG1 real time encoder board 213 is suspended. It is thus 
possible to prevent the MPEG system stream from being destroyed. 

It shouM be noted that, during an encoding suspension period, a picture supplied to the MPEG1 real time encoder 

25 board 213 is not stored in the frame memory unit 110 and, thus, not recorded. Since the number of such frames is 
expected to be not so large, howey^er, no big problem is raised in comparison with a destroyed MPEG system stream. 

As described above, when a free area left in the output buffer 118 becomes smaller than 60 KB in size, the MPEG 
encoding carried out by the MPEG1 real time encoder board 213 is susperxied because of a reason described as fol- 
low. The MPEG encoding carried out by the MPEG1 real time encoder board 213 can be suspended only on a frame 

30 boundary. That is to say. once the MPEG encoding of a frame has been started, the encoding of the frame can not be 
suspended till the encoding is completed. A largest amount of data obtained as a result of MPEG encoding is ou43ut by 
intraframe encoding and. in general, the amount of data obtained as a result of intraframe encoding is expected to be 
about 40 KB. 

Is obvious from the atxive discussion that data of the order of about 40 KB may be supplied to the output buffer 1 1 8 
35 even if an attempt is made to susperxl MPEG encoding. For this reason, it is necessary to assure that a free area with 
a size of at least 40 KB for accommodating such data is still left in the output buffer 1 1 8 before MPEG encoding can be 
suspended. 

That is why, in this embodiment, when a free area left in the output buffer 118 becomes smaller than 60 Kb. the 
MPEG encoding is suspended. It should be noted that the number 60 KB is obtained by adding a safety margin of 20 
40 KB to the data amount 40 KB, 

Next, the dip editor is activated to edit pictures recorded by using the slip recorder. When the clip editor is activated, 
a clip editor main window 361 like one shown in Fig. 21 is displayed. 

With the clip editor main window 361 displayed, the user specifies a clip as an object to be edited. 

As described above, while a clip basically has the same meaning as a tape, in the description of the clip editor, the 
45 term dip is used. Thus, a clip comprises an MPEG file and an index file. 

When a dip is specified, a source window 362 is displayed on the clip editor main window 361 . Index screens of 
the specified clip are further displayed on the source wirxlow 361 . 

To put it in detail, the microprocessor 201 executes the MPEG1 software decoder 201 A shown in Fig. 18 to decode 
encoded data of frames stored in the MPEG file of the specified clip at locations pointed to by scene change pointers 
50 stored in the index file of the same clip. The microprocessor 201 then displays shrunk screens of the decoded frames 
as the index screens on the source window 362. 

It shoukj be noted that, above each of the index screens, a name for identifying the index screen is displayed. In 
the embodiment shown in Fig. 21 , examples of the names displayed above the index saeens are Auto 0, Index 1 , Auto 
2 and Auto 3. 

55 In the examples, the names "Auto n" where n is a number indicate that the index screens are associated with auto- 
matic indexes. On the other hand, the name "Index n" where n is a number is a default name indicating that the index 
screen is associated with a manual index. 

As described above, an automatic index is appended during a recording operation while a manual index can be 
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appended to any arbitrary location on the source window 362 when the user operates typically an index adding button 
366a on a tool bar of a clip editor main window 362. It should be noted that the location corresponds to a position on 
the MPEG system screen limited to the head of the GOP in the case of a manual index. 

it is worth noting that, in an "Index" menu of the clip editor main window 361 . there is included a "Change to manual 
5 index" item which can be clicked to change an automatic index to a manual index. Even if an automatic index is changed 
to a manual index, the name of the index screen representing the automatic index remains unchanged as it is. That is 
to say, the name "Auto n" is not changed to the name "Index n". An automatic index is changed to a manual index by 
inverting the identification flag of the index. 

In addition, the name of an Index saeen associated with an automatic index appearing on the clip editor main win- 
10 dow 361 is displayed in a color different from the name of an index screen associated with a manual index. In this way, 
an index screen associated with an automatic index and an index saeen associated with a manual index can be distin- 
guished from each other with ease. 

An automatic or manual index can be deleted by operating a delete button 366B included in the tod bar of the dip 
editor main window 361 . 

75 At the bottom of tiie source window 362, a time line 363 used as a time axis is displayed. Typically, tiie left edge of 
an index screen coincides with a corresponding point of time on the time line 363. It should be noted that the corre- 
sponding point of time on the time line 363 is a time at which tiie index screen is recorded with tiie start of the recording 
taken as a reference. 

An index screen is basically the first frame of a scene change. Thus, frames from an irxJex screen to a frame imme- 
20 diately preceding tiie next index screen basically constitute a scene. Therefore, the user is capable of searching index 
screens for a desired one with ease. 

When it is desired to confirm a picture after index saeens have been displayed, a point on the time line 363 is 
dragged by using the mouse 22 along tiie time line 363 over a desired range. By doing so, tiie traced range is denoted 
by the symbol R in Fig. 21 and the range R is taken as a playback range. Then, when a playback fcxjtton 367 included 
25 in the tool bar of the clip editor main window 361 is clicked, for example, a playback operation is carried out over tiie 
playback range R. 

To put it in detail, in this case, the playt^ack window 341 shown in Fig. 15 is typically opened. Then, the MPEG1 
software decoder 201 A is executed to decode an MPEG system stream con^esporxiing to the playback range R and dis- 
play pictures resulting from tiie decoding on tiie picture display area 342 of the playback window 341 . 
30 As a result, the user is capable of confirming a scene with ease. 

The user looks at irKlex screens and, if necessary, further confirms a scene to determine a scene to be used in edit- 
ing. The user tiien clicks an edit point file creation button 368 included in the tool t^ar of the dip editor main wirxiow 361 
to display an output window 369 beneath the source window 362 on tiie clip editor main window 361 as shown in Rg. 
21. 

35 After tiie output window 369 is displayed, tiie user traces a range on the time line 363 in tiie source window 362 by 
dragging using the mouse 22. An index screen in the range is copied as a scene to a new dip. To put it in detail, an area 
on tiie source window 362 from an index screen at tiie beginning of the traced range to a frame immediately preceding 
an index screen immediately succeeding the traced range is the object to be copied to the new clip. On tiie time line 
363 of the source window 362, a start mark 364L and an end mark 364R are displayed at positions corresponding to 

40 the start and end points of tiie object to be copied respectively A background on the source window 362 in the area 
taken as tiie object to be copied and tiie traced range on the time line 363 are displayed in a color different from the rest. 

The area Is copied to the output window 369 by carrying out operations as follows. When a cursor of the mouse 22 
is moved 1o a position in the area of the object to be copied and the mouse 22 is pressed and dragged from tiie position, 
the shape of the cursor is changed from typically a shape resembling an arrow to a shape symbolizing an index screen. 

45 It should be noted tiiat the cursor itself is not shown in tiie figure. Witii the mouse 22 pressed as it is, the cursor is 
dragged to a position in tiie output window 369. As tiie mouse 22 Is released from tiie pressed state, tiie index screen 
pointed to by the cursor is copied from the source window 362 to the output window 369. In tiie embodiment shown in 
Fig. 21 , a scene with an index screen named "Auto 0" serving as the head frame tiiereof and a scene with an index 
screen named "Auto 2" serving as tiie head frame tiiereof have been copied from the source window 362 to the output 

50 window 369. 

It shouki be noted tiiat, when an object to be copied is copied from the source window 362 to the output window 
369, all automatic indexes In tiie object are deleted from tiie output window 369. In addition, if tiie head frame of an 
object copied has an appended automatic index, the automatic index is changed to a manual index. 

All automatic indexes In the copied object are deleted from the output window 369 for the following reason. The 
55 video CD creator, one of the application programs of the Slipdip software, can be used to create a video CD for record- 
ing scenes copied to tiie output window 369. When a video CD is created by tiie video CD creator, an index conforming 
to video CD specifications is set at a location pointed to by each scene change pointer recorded in the index file. 

An automatic index Is provided to help the user find a desired scene with ease. Basically, a large number of auto- 
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matic indexes are recorded. If the large number of automatic indexes are not deleted, they will remain In the video CD 
created by the video CD creator. 

On the other hand, each automatic index of the head frame of an object copied to the output window 369 is 
changed to a manual Index because of the following reason. The head frame of a copied object conresponds to an edit 
point. It is desirable to keep an index also for an edit point in a video CD. If an automatic index of the head frame of an 
object copied to the output window 369 is not changed to a manual index, the automatic index will be deleted. Thus, an 
automatic index of the head frame of an object copied to the output window 369 is changed to a manual index in order 
to prevent the automatic Index from being deleted. 

As a result, only manual index screens associated with manual indexes are displayed on the output window 369. If 
it is desired to leave an index at the position of an automatic index, it is necessary to change the automatic index to a 
manual index in the way described earlier before copying an object to the output window 369. 

It should be noted that an automatic index can be prevented from being deleted es/en if an object including the auto- 
matic object is copied to the output window 369. In addition, it is also possible to present an automatic index of the head 
frame of an object copied to the output window 369 from being changed to a manual index. 

As described above, the user is capable of copying a desired scene to the output window 369. In addition, since 
the user is also capable of moving, deleting and rearranging scenes copied to the output window 369, the user is 
allowed to carry out editing by doing such work if necessary. 

Then after desired scenes are rearranged in a desired order on the output window 369, it may be desired to newly 
create a clip for storing the rearranged scenes. In this case, a build start button 370 included in the tool bar of the clip 
editor window 361 is typically operated to create such a new clip. 

When the buiki start tHitton 370 is operated, the microprocessor 201 reads out encoded data of the desired scenes 
laid out on the output window 369 from the MPEG file by refen-ing to the index file. After necessary processing is earned 
out for each junction point (or edit point) with elementary data (or an elementary stream) of the encoded data read out 
from the MPEQ file used as it is, only system encoding is performed again. Results of the encoding are stored in the 
hard disc 212 as a new MPEQ file. 

It should be noted that, at the same time, an new index file for index screens displayed on the output window 369 
is also created. It is obvious from the above description that the new index file will include only manual indexes and 
Include no automatic indexes. The new index file and the newly created MPEG file are stored in the hard disc 212 as a 
new clip. 

As described above, index screens associated with automatic indexes stored in the irxjex file are displayed on the 
source window 362. A large number of index screens separated away from each other by not so large intervals may 
thus be displayed on the source window 362, adversely forming a hindrance to a search carried out by the user for a 
desired scene. 

In order to solve the problem described above, in this embodiment, index screens associated with automatic 
indexes stored in the index file can be displayed on the source window 362 conditionally That is to say, only index 
screens satisfying a certain condition are displayed on the source window 362. For tiie sake of convenience, such a 
condition is referred to hereafter as a display condition. 

Fig. 22 is a diagram showing an index display level setting dialog box 381 used by tiie user for setting a display con- 
dition. 

It shouki be noted that tiie index display level setting dialog box 381 can be displayed typically by clicking an ''Index 
display les^el setting" item in a "Display" menu of the clip editor main window 361 shown in Fig. 21 . 

A "display air f ieki 382 on the index display level setting dialog box 381 is specified by being clicked to set a display 
condition which stipulates that index screens associated with alt automatic indexes recorded in an index file be dis- 
played. A level f iekl 383 is specified by being clicked to set a display condition which stipulates that only index screens 
associated witii automatic indexes with the scene change parameters thereof exceeding a predetermined threshokl 
value be displayed on the source window 362. The threshokJ value is entered by the user to a threshold value input fiekl 
383A. 

A screen count fiekj 384 is specified by being clicked to set a display condition which stipulates tiiat only up to a 
specified number of index screens associated with automatic indexes having large scene change parameters be dis- 
played on the source window 362 witii automatic indexes having large scene change parameters given high priority. 
The maximum number of index screens is specified by the user to a "maximum number of saeens to be displayed" f ieki 
385. 

A maximum level display fiekl 386 is specified by being clicked to set a display corxiition which stipulates that only 
an index screen associated witii an automatic index having the largest scene change parameter in each of intervals be 
displayed on tiie source window 362. The length of each interval is entered by the user to time interval input fields 387. 

When one of the display conditions described above is selected, tiie number of automatic indexes to be displayed 
under the selected condition and the total numk>er of all automatic indexes recorded in tiie index file are displayed on a 
"Number of displayed indexesHbtal number of all indexes" fiekJ 388. 
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It should be noted that an OK button 389 is operated to confirm set items newly entered to the index display level 
setting dialog box 381 and to dose the index display level setting dialog box 381. A cancel button 390 is operated to 
keep set items previously confirmed and entered to the index display level setting dialog box 381 and to close the index 
display level setting dialog box 381. A help button 391 is operated to display explanations for helping the user under- 
5 stand the index display level setting dialog box 381 . 

Thus, only index screens associated with automatic indexes stored in the index file are displayed on the source win- 
dow 362 shown in Fig. 21 in accordance with a display condition set by using the index display level setting dialog box 
381 as described above. 

Fig. 23 shows a flowchart representing an index screen displaying process to display index screens on the source 
10 window 362 conditionally As shown in the figure, the flowchart begins with a step S61 to form a judgment as to whether 
or not the "display all" field 382 is selected. If the "display all" field 382 is found selected, the flow of the process goes 
on to a step S62 at which index screens associated with all automatic indexes recorded in an index file are displayed 
on the source window 362 and the process is finished. 

If the outcome of the judgment formed at the step S61 Indicates that the "display all" field 382 is not selected, on 
IS the other hand, the flow of the process goes on to a step S63 to form a judgment as to whether or not the level field 383 
is selected. If the level field 383 is found selected, the flow of the process goes on to a step S64 at which the index file 
is searched for automatic indexes with the scene change parameters thereof exceeding a predetermined threshold 
value entered to the threshold value input field 383A. The flow then proceeds to a step S68 at which only index screens 
associated with the automatic indexes found in the search are displayed on the source window 362. The process Is then 
20 finished. 

If the outcome of the judgment formed at the step S63 indicates that the level" field 383 is not selected, on the 
other hand, the flow of the process goes on lo a step S65 to form a judgment as to whether or not the screen count field 
384 is selected. If the saeen count field 384 is found selected, the flow of the process goes on to a step S66 at which 
the index file is searched for n automatic indexes having largest scene change parameters where n Is a number spec- 

25 ified in the "maximum number of screens to be displayed" field 385. The flow then proceeds to the step S68 at which 
only index screens associated with the n automatic indexes found in the search are displayed on the source window 
362. The process is then finished. 

If the outcome of the judgment formed at the step S65 indicates that the screen count field 384 is not selected, that 
is. neither the "display all" field 382, the level field 383 nor the screen count field 384 is selected or, in other words, the 

30 maximum level display field 386 is specified, on the other hand, the flow of the process goes on to a step S67 at which 
the index file Is searched for an autonratic index having a largest scene change parameter in each of intervals where 
the length of each interval has been entered by the user to time interval Input fields 387. The flow then proceeds to the 
step S68 at which only index screens associated with the automatic indexes fburxi in the search are displayed on the 
source window 362. The process is then finished. 

35 As described akX3ve, since the number of index screens displayed on the source window 362 can be limited by. 
anrK}ng other things, the magnitudes of scene change parameters, the user is capable of finding a desired scene with 
ease. 

In this embodiment, with the level field 383 selected, the threshold value of the scene change parameter which is 
normally specified by the user in a threshold value input field 383A can be changed without re-opening the index display 

40 level dialog box 381 . That is to say, the threshold value can be changed by operating a down button 365A or an up but- 
ton 365B of the tod bar of the clip editor main window 361 shown in Fig. 21 . To be nnore specif ic, each time the down 
button 365A is operated, the scene change parameter is decremented by 1 . As a result, the number of displayed index 
screens inaeases due to a smaller threshold value. Each time the up button 365B is operated, on the other hand, the 
scene change parameter Is incremented by 1 . As a result, the number of displayed index screens decreases due to a 

45 larger threshold value. 

As described akxsve, the number of index screens each associated with an automatic index is limited by a display 
condition. It should be noted that such limitation also can be applied to manual indexes as welt. 

Assume that a clip (or a tape) is created by using the slip recorder and the clip is edited by using the clip editor to 
give a new clip. The number of dips thus increases. If there are a number of clips. It will be diff Icutt to identify the con- 
50 tents of each of the clips from the file names of the clips only. In order to solve this problem SlipdIp includes an appli- 
cation program called the clip viewer. 

When the clip viewer is activated, a clip viewer main window 401 like one shown in Fig. 24 is displayed. 

As shown in the figure, the dip viewer main window 401 includes a clip view 402 a showing representative screen 
of each dip cataloged in a clip collection. 
55 A clip collection is a folder used for classifying clippers. A representative scene of a clip is one of screens compos- 
ing the clip. By deMult. the first screen of a clip is the representative screen of the clip. The representative screen of a 
clip can be changed from the default screen, that is, the first screen, to another screen of the same clip. 

On a tab 402A, names assigned to dip collections are displayed. Thus. In this embodiment, 3 folders exists each 



31 



EP0 890 910A2 



as a clip collection. The names assigned to the 3 clip collections are "Summer Travels", "SW Tournament" and "Christ- 
mas^ It should be noted that a clip collection is selected by clicking the name on the lab 402A assigned to the clip col- 
lection. When a dip collection is selected, representative saeens of clips cataloged in the selected clip collection are 
displayed on the clip view 402. In the embodiment shown in Fig. 24, a clip collection named "Summer Travel" has been 
5 selected and representative screens of 3 clips cataloged in the clip collection named "Summer Travel" are displayed on 
the clip view 402. 

When one of the representative screens displayed on the clip view 402 is clicked, index screens of a clip repre- 
sented by the clicked representative screen are displayed on an index view 403. 

On a picture display area 404, on the other hand, played back pictures of the clip represented by the clicked repre- 
10 sentative screen on the clip view 402 are displayed. At the same time, the title of the clip represented by the clicked rep- 
resentative screen on the clip view 402 is displayed on a title field 405. That is to say, with the clip viewer, each dip can 
be given a title which is displayed on the title field 405. 

A stop button 406. a playback button 407. a pause button 408. skip buttons 409 and 410, index buttons 41 1 and 
412, a slider 414, a frame feed button 415 and a slow playback button 416 have the same functions as the stop button 
15 346. the playback button 347, the pause button 348. the skip buttons 349 and 350, the index buttons 351 and 352, the 
slider 354, the frame feed button 355 and the slow playback button 356 of the playback window 341 shown in Fig. 15 
respectively. 

A full screen button 413 is operated to display the screen display area 404 on the full screen. An explanatory 
description of a clip selected from those displayed on the clip view 402 is displayed on a description field 417. That is 
20 to say, with the clip viewer, each clip can be explained by a description which is displayed on the description field 417. 
As described above, in this embodiment, pictures are encoded and compressed and code resulting from the 
encoding and compression is then recorded. It should be noted, however, that the above desaiption is not intended to 
be construed in a limiting sense. That is to say, the scope of the present invention is not limited to such an embodiment. 
For example, the present invention can be applied to an application wherein pictures are recorded as they are without 
25 being encoded. However, whether or not a slip playback function can be executed much depends on the transfer speed 
and the head seek time of the hard disc 212 and the amount of data to be recorded or the data rate. 

To put it in detail, for example, consider a hard disc 212 with a transfer rate of 4 Mbps and a head seek time of 20 
ms as is the case of the emkxx:liment described above. 

Assume that, in recording and playt>ack operations, the anrount of data per frame is the same as the "Normal" video 
30 recording mode and consider a transfer of 15 frames or 1 ,856 KB as computed before. The length of time it takes to 
write or read out 1 .856KB picture data into or from the hard disc 212 is about 453 ms (= 1 ,856 KB/4 x 1 ,024 [KB/sec]). 
Taking the 20ms head seek time into consideration, the write and read times are both atx)ut 473 ms. In order to carry 
out operations to read out and write picture data of 15 frames concurrently, it takes about 946 ms (= 473 ms + 473 ms) 
which exceeds a period of time of about 0.5 seconds, a period corresponding to 15 frames at a frame rate of 30 frames 
35 per second as described previously. Thus, the operations can not be carried out ooncunrently during the O.Ssec period 
of time. 

Consider now a "Long" video recording mode in place of "Normal" with the other conditions in the read and write 
operations remaining unchanged. In this case, the amount of picture data of 15 frames is 394 KB. The length of time it 
takes to write or read out 394KB picture data into or from the hard disc 212 is about 96.2 ms (» 394 KB/4 x 1 ,024 

40 [KB/sec]). Taking the 20ms head seek time into consideration, the write and read times are both about 116.2 ms. In 
order to carry out operations to read out and write picture data of 15 frames concun-ently, it takes about 1232.4 ms (= 
1 1 6.2 ms + 1 1 6.2 ms) which is shorter than a period of time of about 0.5 seconds, a period conresponding to 1 5 frames 
at a frame rate of 30 frames per second as described previously. Thus, the operations can be carried out concurrently 
during the 0.5sec period of time. 

45 As desaibed above, in the embodiment, picture data is subjected to encoding conforming to MPEG1 specifica- 
tions, one of fixed rate encoding techniques. It shoukl be noted, however, that the technique of encoding picture data is 
not limited to the encoding conforming to the MPEG1 specifications. As a matter of fact, picture data can be encoded 
at a variable rate. With picture data encoded at a variable rate, however, it is difficult to detect the location at which 
encoded data is recorded from the number of bytes representing an offset relative to a recording start position in 

50 processing such as a slip playback operation. 

Also as described above, in the embodiment, a slip playback operation is carried out to reproduce pictures and their 
accompanying sound. It is worth noting, however, that a slip playt>ack operation can also be carried out to reproduce 
other data. By the same token, a tape can be allocated for recording data other than pictures and sound. 

According to a picture processing apparatus claimed as claim 1 and a picture processing method claim as claim 9. 

55 a scene change parameter representing a degree of a scene change in a picture is computed; and the scene change 
parameter and position information on a position of the picture with a degree of a scene change thereof represented by 
the scene change peirameter are recorded by associating the scene change parameter with the position information. 
In addition, a recording medium according to claim 10 is used for storing a program to let a computer process a 
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picture wherein the program prescribes a picture processing method comprising the steps of: connputing a scene 
change parameter representing a degree of a scene change in the picture; and recording the scene change parameter 
and position information on a position of the picture with a degree of a scene change thereof represented by the scene 
change parameter by associating the scene change parameter with the position information. Furthermore, a recording 
medium according to claim 1 1 is used for storing data obtained as a result of processing a picture in addition to a scene 
change parameter and position information on a position of the picture with a degree of a scene change thereof repre- 
sented by the scene change parameter by associating the scene change parameter with the position information. 
As a result, a desired scene can be found with ease. 

Claims 

1 . A picture processing apparatus for processing a picture comprising: 

a computing means (201) for computing a scene change parameter representing a degree of a scene change 
in said picture; and 

a recording means (201) for recording said scene change parameter and position information on a position of 
said picture with a degree of a scene change thereof represented by said scene change parameter by associ- 
ating said scene change parameter with said position information. 

2. A picture processing apparatus according to claim 1 also having: 

a threshold value setting means (381) for setting a threshold value of said scene change parameter; and 
a display means (362) for displaying a screen of said picture at a position indicated by said position information 
associated with said scene change parameter representing a degree of a scene change equal to or higher than 
said threshold value set by using said threshold value setting means (381). 

3. A picture processing apparatus according to claim 1 also having: 

a scene change parameter count setting means (381) for setting a scene change parameter count; and 
a display means (362) for displaying screens of said pictures at positions indicated by pieces of said position 
information associated with said scene change parameters representing highest degrees of scene changes 
wherein the number of screens to be displayed does not exceed said scene change parameter count set by 
using said scene change parameter count setting means (381). 

4. A picture processing apparatus according to claim 1 also having: 

a range setting means (381) for setting a range to be searched for a scene change parameter representing a 
highest degree of a scene change among scene changes in said range; and 

a display means (362) for searching each range set by said range setting means (381) for a specific scene 
change parameter representing a highest degree of a scene change among scene changes in said range and 
displaying a screen of said picture at a position Indicated by said position information associated with said spe- 
cific scene change parameter. 

5. A picture processing apparatus according to claim 1 also having: 

a detection means (201) for detecting a scene change parameter representing a degree of a scene change 
equal to or higher than a predetermined level; and 

a display means (303) for displaying detection of a scene change parameter representing a degree of a scene 
change equal to or higher than said predetermined level. 

6. A picture processing apparatus according to claim 1 wherein said recording means (201) also records said picture. 

7. A picture processing apparatus according to claim 6 wherein said recording means has an encoding means (213) 
for encoding said picture to be recorded by said recording means. 

8. A picture processing apparatus according to claim 6 wherein said recording means (201) records said picture, said 
scene change parameter and said position information separately. 
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. A picture processing method for processing a picture comprising the steps off: 



computing a scene change parameter representing a degree of a scene change in said picture; and 
recording said scene change parameter and position information on a position of said picture with a degree of 
a scene change thereof represented by said scene change parameter by associating said scene change 
parameter with said position information. 

0. A recording medium for storing a program to let a computer process a picture wherein said program prescribes a 
picture processing method comprising the steps of: 

computing a scene change parameter representing a degree of a scene change in said picture: and 
recording said scene change parameter and position information on a position of said picture with a degree of 
a scene change thereof represented by said scene change parameter by associating said scene change 
parameter with said position information. 

1. A recording medium for storing data obtained as a result of processing a picture in addition to a scene change 
parameter and position information on a position of said picture with a degree of a scene change thereof repre- 
sented by said scene change parameter by associating said scene change parameter with said position informa- 
tion. 
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